-- Logs begin at Tue 2022-09-13 06:20:49 UTC, end at Tue 2022-09-13 07:19:35 UTC. -- Sep 13 06:52:31.670458 dv-cinder-856941-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 06:52:31.679661 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 06:52:31.681624 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 06:52:31 2022] *** Sep 13 06:52:31.681624 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 06:52:31.681624 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 06:52:31.681624 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: nodename: dv-cinder-856941-4-iscsi Sep 13 06:52:31.681624 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: machine: x86_64 Sep 13 06:52:31.681624 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: clock source: unix Sep 13 06:52:31.681624 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: pcre jit disabled Sep 13 06:52:31.681624 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: detected number of CPU cores: 4 Sep 13 06:52:31.681624 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: current working directory: / Sep 13 06:52:31.681624 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: detected binary path: /usr/bin/uwsgi-core Sep 13 06:52:31.682336 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: your processes number limit is 47680 Sep 13 06:52:31.682336 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: your memory page size is 4096 bytes Sep 13 06:52:31.682336 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: detected max file descriptor number: 2048 Sep 13 06:52:31.682336 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: lock engine: pthread robust mutexes Sep 13 06:52:31.682336 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: thunder lock: enabled Sep 13 06:52:31.682336 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 06:52:31.682336 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 06:52:31.721022 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: Python main interpreter initialized at 0x55d39cf719c0 Sep 13 06:52:31.721022 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: python threads support enabled Sep 13 06:52:31.721022 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: your server socket listen backlog is limited to 100 connections Sep 13 06:52:31.721022 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: your mercy for graceful operations on workers is 90 seconds Sep 13 06:52:31.721374 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 06:52:31.721457 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: *** Operational MODE: preforking *** Sep 13 06:52:31.721683 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: *** uWSGI is running in multiple interpreter mode *** Sep 13 06:52:31.721683 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: spawned uWSGI master process (pid: 105500) Sep 13 06:52:31.721882 dv-cinder-856941-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 06:52:31.722538 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: spawned uWSGI worker 1 (pid: 105501, cores: 1) Sep 13 06:52:31.724351 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: spawned uWSGI worker 2 (pid: 105502, cores: 1) Sep 13 06:52:31.724351 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 06:52:32.378032 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 06:52:32.378707 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 06:52:33.446741 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 06:52:33.446741 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: from cryptography.utils import int_from_bytes Sep 13 06:52:33.447501 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 06:52:33.447501 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: from cryptography.utils import int_from_bytes Sep 13 06:52:33.447977 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 06:52:33.447977 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: from cryptography.utils import int_from_bytes Sep 13 06:52:33.448446 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 06:52:33.448446 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: from cryptography.utils import int_from_bytes Sep 13 06:52:35.892874 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 06:52:35.893456 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 06:52:35.893562 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 06:52:35.893562 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 06:52:35.894033 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 06:52:35.894152 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 06:52:35.894241 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 06:52:35.894241 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 06:52:35.894386 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 06:52:35.894386 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 06:52:35.894542 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.894795 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.894926 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.895106 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.895245 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.895395 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.895493 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.895739 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.895882 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.896013 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.896118 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.896358 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.896489 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.896665 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.896796 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.896981 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.897126 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.897223 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.897310 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.897503 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.897696 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.897806 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856941-4-iscsi {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.898007 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.898125 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.898367 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856941-4-iscsi {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.898460 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.898688 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.898799 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.898998 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.899089 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.899292 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.899382 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.899605 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.899705 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.899911 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.900001 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.900236 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.900401 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.900580 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.901755 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.901864 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.901954 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.902029 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.902247 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.902345 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.902416 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.902494 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.902563 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.902639 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.902715 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.902789 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.902866 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.903119 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.903202 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.903278 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.903359 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.903535 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.903632 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.903792 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.904004 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856941-4-iscsi {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.904158 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.904315 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.904549 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856941-4-iscsi {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.904672 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.904869 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.904978 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.905180 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.905308 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.905493 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.905631 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.905905 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.906021 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.906246 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.906356 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.906558 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.906642 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.906860 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.906941 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.907180 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.907266 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.907487 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.907584 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.907798 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.907893 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.908110 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.908196 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.908407 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.908499 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.908709 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.908800 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.909012 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.909098 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.909321 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.909404 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.909617 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.909710 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.909917 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.910008 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.910187 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.910286 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.910491 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.910585 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.910784 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.910878 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.911094 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.911184 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.911405 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.911501 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.911654 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.911742 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.911900 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.912031 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.912216 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.912309 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.912517 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.912608 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.912818 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.912910 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.913119 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.913203 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.913422 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.913512 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.913722 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.913815 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.914024 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.914156 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.914347 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.914434 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.914646 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.914739 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.914953 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.915082 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.915255 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.915349 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.915562 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.915667 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.915875 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.915975 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.916177 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.916268 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.916491 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.916582 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.916797 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.916895 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.917111 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.917200 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.917412 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.917502 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.917734 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.917823 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.918042 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.918166 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.918368 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.918464 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.918681 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.918773 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.918999 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.919090 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.919302 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.919392 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.919714 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.919819 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.919984 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.920087 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.920294 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.920389 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.920602 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.920694 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.920908 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.921012 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.921161 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.921308 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.921457 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.921548 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.921757 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.921860 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.922063 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.922186 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.922392 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.922484 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.922695 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.922791 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.922997 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.923091 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.923294 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.923386 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.923597 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.923694 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.923896 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.923979 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.924196 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.924284 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.924498 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.924584 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.924798 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.924892 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.925101 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.925198 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.925397 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.925483 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.925698 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.925783 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.925997 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.926108 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.926321 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.926409 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.926626 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.926722 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.926932 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.927017 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.927230 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.927314 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.927530 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.927634 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.927829 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.927927 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.928130 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.928227 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.928431 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.928524 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.928731 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.928823 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.929031 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.929117 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.929340 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.929424 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.929638 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.929729 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.929937 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.930030 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.930269 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.930358 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.930572 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.930678 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.930874 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.930977 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.931181 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.931477 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.931613 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.931771 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.932074 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.932223 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.932359 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.932495 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.932665 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.932819 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.933305 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.933444 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.933579 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.933715 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.933878 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.934030 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.934219 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.934358 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.934501 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.934642 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.934783 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.935011 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.935172 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.935326 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.935572 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.935727 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.935873 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.936000 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.936206 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.936356 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.936499 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.936640 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.936785 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.936924 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.937104 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.937251 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.937411 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.937581 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.937740 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.937894 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.938040 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.938340 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:52:35.938451 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.938684 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.938790 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.939022 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.939113 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.939349 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.939439 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.939667 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.939773 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.940003 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.940215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.940375 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.940607 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.940770 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.940904 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.940997 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.941219 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.941318 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.941531 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.941631 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.941846 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.941936 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.942191 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.942299 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.942506 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.942618 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.942827 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.942917 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.943139 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.943230 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.943453 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.943553 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.943766 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.943856 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.944074 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.944164 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.944387 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.944498 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.944699 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.944788 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.945013 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.945103 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.945320 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.945411 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.945648 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.945752 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.945961 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.946061 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.946307 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.946397 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.946627 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.946718 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.946943 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.947042 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.947252 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.947344 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.947559 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.947650 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.947864 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.947969 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.948174 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.948264 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.948487 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.948586 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.948791 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.948889 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.949102 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.949197 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.949408 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.949498 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.949723 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.949822 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.950025 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.950149 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.950354 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.950461 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.950692 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.950931 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.951524 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.951625 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.951709 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.951798 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.951880 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.951969 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.952052 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.952137 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.952264 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.952489 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.952637 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.952784 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.952884 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.953129 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.953263 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.953445 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.953592 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.953756 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.953889 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.954056 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.954234 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.954371 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.954489 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.954660 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.954805 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.954934 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.955050 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.955263 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.955410 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.955534 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.955637 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.955865 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.956007 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.956176 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.956324 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.956441 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.956534 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.956789 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.956941 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.957042 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.957132 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.957376 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.957510 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.957673 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.957776 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.957961 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.958047 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.958267 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.958358 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.958561 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.958662 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.958867 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.958959 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.959167 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.959267 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.959485 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.959582 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.959786 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.959875 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.960084 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.960175 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.960402 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.960500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.960697 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.960786 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.960996 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.961086 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.961336 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.961497 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.961597 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.961679 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.961929 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.962064 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.962260 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.962414 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.962545 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.962651 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.962871 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.963002 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.963181 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.963324 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.963471 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.963571 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.963783 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.963872 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.964095 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.964187 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.964406 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.964496 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.964711 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.964801 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.965022 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.965112 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.965331 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.965421 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.965624 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.965712 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.965927 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.966017 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.966247 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.966339 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.966870 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.966994 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.967080 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.967160 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.967238 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.967324 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.967470 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.967569 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.967768 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.967858 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.968064 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.968154 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.968350 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.968458 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.968637 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.968722 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.968959 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.969074 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.969252 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.969353 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.969549 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.969647 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.969846 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.969942 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.970148 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.970246 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.970464 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.970554 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.970767 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.970858 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.971070 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.971169 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.971407 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.971504 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.971718 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.971808 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.972035 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.972125 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.972344 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.972487 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.972666 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.972808 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.972972 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.973131 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.973275 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.973444 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.973564 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.973747 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.973866 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.974059 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.974203 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.974395 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.974509 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.974707 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.974821 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.975019 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.975128 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.975337 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.975430 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.975650 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.975737 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.975969 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.976056 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.976278 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.976364 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.976601 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.976709 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.976915 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.977007 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.977233 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.977319 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.977538 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.977623 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.977851 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.977938 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.978178 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.978329 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.978493 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.978600 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.978800 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.978891 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.979104 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.979204 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.979410 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.979500 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.979711 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.979801 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.980022 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.980127 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.980325 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.980415 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.980632 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.980729 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.980934 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.981037 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.981247 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.981351 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.981553 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.981644 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.981862 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.981961 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.982262 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.982355 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.982579 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.982726 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.982900 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.983044 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.983224 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.983367 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.983530 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.983676 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.983836 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.983995 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.984150 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.984325 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.984455 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.984660 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.984755 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.984974 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.985060 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.985287 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.985373 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.985610 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.985710 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.985917 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.986000 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.986249 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.986351 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.986558 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.986647 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.986861 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.986946 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.987159 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.987252 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.987470 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.987555 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.987772 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.987856 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.988070 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.988154 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.988367 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.988459 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.988670 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.988767 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.988985 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.989091 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.989290 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.989379 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.989590 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.989675 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.989895 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.989988 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.990214 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.990304 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.990513 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.990599 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.990827 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.990926 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.991134 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.991219 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.991433 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.991536 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.991731 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.991825 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.992030 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.992115 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.992350 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.992436 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.992662 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.992756 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.992958 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.993042 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.993260 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.993344 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.993567 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.993661 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.993872 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.993956 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.994200 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.994290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.994508 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.994595 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.994811 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.994897 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.995123 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.995212 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.995430 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.995513 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.995735 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.995820 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.996041 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.996128 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.996344 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.996431 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.996651 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.996737 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.996955 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.997048 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.997266 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.997351 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.997567 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.997652 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.998163 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.998282 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.998377 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.998458 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.998676 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.998762 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.998981 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.999075 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.999276 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.999384 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.999698 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:35.999850 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.000014 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.000185 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.000320 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.000499 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.000633 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.000820 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.000955 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.001158 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.001470 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.001564 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.001797 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.001884 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.002150 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.002253 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.002466 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.002552 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.002766 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.002851 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.003071 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.003166 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.003370 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.003464 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.003668 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.003754 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.003974 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.004060 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.004274 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.004361 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.004571 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.004657 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.004868 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.004953 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.005173 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.005260 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.005471 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.005558 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.005768 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.005853 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.006065 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.006184 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.006383 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.006469 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.006691 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.006776 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.006990 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.007077 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.007292 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.007377 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.007587 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.007681 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.007888 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.007981 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.008188 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.008274 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.008489 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.008584 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.008787 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.008876 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.009082 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.009163 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.009400 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.009498 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.009701 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.009786 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.010003 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.010108 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.010334 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.010508 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.010643 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.010731 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.010963 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.011048 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.011261 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.011351 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.011577 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.011673 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.011880 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.011973 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.012181 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.012267 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.012477 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.012564 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.012782 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.012875 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.013086 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.013174 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.013527 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.013887 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.013887 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.014038 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.014168 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.014252 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.014428 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.014516 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.014742 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.014837 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.015048 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.015133 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.015350 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.015434 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.015648 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.015746 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.015957 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.016042 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.016258 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.016342 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.016556 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.016652 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.016852 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.016938 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.017154 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.017246 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.017456 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.017556 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.017753 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.017839 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.018058 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.018179 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.018378 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.018464 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.018689 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.018775 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.018984 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.019070 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.019284 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.019377 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.019582 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.019668 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.019885 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.019969 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.020188 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.020286 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.020485 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.020571 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.020787 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.020872 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.021091 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.021185 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.021388 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.021479 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.021690 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.021789 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.021991 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.022094 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.022317 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.022401 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.022617 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.022714 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.022924 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.023010 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.023228 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.023320 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.023536 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.023631 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.023835 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.023922 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.024135 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.024229 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.024432 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.024525 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.024729 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.024814 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.025026 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.025112 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.025331 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.025418 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.025628 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.025720 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.025929 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.026014 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.026249 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.026339 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.026548 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.026634 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.026845 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.026941 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.027143 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.027236 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.027447 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.027537 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.027742 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.027827 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.028040 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.028128 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.028337 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.028421 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.028654 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.028747 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.029008 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.029198 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.029309 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.029386 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.029614 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.029709 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.029920 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.030006 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.030258 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.030358 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.030569 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.030664 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.030874 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.030959 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.031184 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.031271 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.031481 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.031576 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.031792 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.031878 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.032100 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.032185 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.032415 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.032501 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.032714 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.032799 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.033014 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.033100 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.033328 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.033421 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.033634 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.033719 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.033941 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.034027 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.034269 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.034358 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.034576 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.034662 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.034892 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.034976 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.035192 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.035278 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.035499 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.035592 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.035803 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.035889 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.036108 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.036209 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.036412 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.036499 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.036720 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.036819 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.037025 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.037118 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.037333 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.037418 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.037637 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.037734 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.037942 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.038028 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.038268 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.038354 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.038572 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.038741 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.038878 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.038973 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.039186 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.039270 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.039480 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.039575 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.039793 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.039880 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.040095 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.040186 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.040393 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.040480 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.040700 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.040786 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.040996 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.041081 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.041301 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.041401 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.041599 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.041693 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.041899 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.042024 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.042240 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.042360 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.042546 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.042664 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.042857 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.042951 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.043160 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.043251 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.043537 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.043623 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.043846 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.043944 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.044155 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.044242 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.044454 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.044546 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.044836 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.045039 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.045415 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.045489 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.045569 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.045647 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.045726 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.045819 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.046012 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.046119 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.046403 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.046489 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.046709 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.046805 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.047027 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.047113 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.047327 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.047413 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.047629 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.047715 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.047924 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.048009 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.048230 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.048317 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.048525 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.048618 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.048841 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.048926 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.049142 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.049249 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.049446 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.049560 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.049766 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.049851 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.050071 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.050286 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.050412 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.050595 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.050827 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.050914 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.051142 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.051242 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.051446 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.051539 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.051808 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.051907 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.052109 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.052195 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.052421 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.052517 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.052731 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.052817 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.053047 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.053133 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.053365 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.053461 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.053672 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.053759 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.053981 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.054074 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.054306 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.054406 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.054624 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.054724 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.054941 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.055034 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.055250 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.055345 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.055564 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.055650 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.055866 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.055973 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.056192 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.056280 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.056512 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.056599 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.056824 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.056911 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.057146 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.057241 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.057478 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.057572 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.057778 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.057872 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.058451 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.058548 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.058756 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.058843 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.059056 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.059143 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.059372 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.059476 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.059672 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.059758 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.059977 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.060071 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.060430 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.060891 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.060981 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.061077 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.061160 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.061296 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.061384 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.061610 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.061704 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.061906 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.061991 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.062253 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.062344 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.062566 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.062665 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.062871 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.062957 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.063181 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.063269 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.063476 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.063562 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.063794 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.063888 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.064101 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.064194 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.064400 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.064486 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.064723 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.064827 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.064995 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.065090 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.065323 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.065410 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.065620 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.065722 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.065936 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.066023 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.066281 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.066369 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.066586 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.066684 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.066890 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.066977 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.067215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.067301 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.067528 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.067622 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.067837 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.067923 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.068143 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.068238 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.068454 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.068548 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.068772 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.068866 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.069070 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.069156 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.069367 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.069462 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.069672 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.069807 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.069969 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.070056 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.070291 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.070379 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.070586 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.070672 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.070890 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.070992 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.071187 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.071281 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.071484 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.071571 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.071782 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.071880 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.072103 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.072190 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.072403 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.072498 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.072717 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.072814 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.073020 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.073106 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.073318 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.073403 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.073616 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.073711 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.073914 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.074000 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.074288 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.074377 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.074588 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.074676 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.074907 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.074997 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.075212 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.075297 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.075518 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.075605 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.075910 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.076496 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.076746 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.076983 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.077210 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.077462 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.077548 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.077629 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.077708 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.077788 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.077877 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.077960 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.078055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.078160 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.078253 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.078424 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.078516 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.078605 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.078720 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.078809 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.079037 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.079138 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.079353 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.079557 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.079672 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.079882 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.079975 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.080195 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.080283 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.080505 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.080592 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.080818 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.080904 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.081126 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.081389 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.081476 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.081720 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.081815 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.082026 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.082147 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.082358 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.082497 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.082665 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.082753 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.082978 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.083071 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.083292 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.083379 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.083608 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.083693 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.083918 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.084004 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.084231 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.084318 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.084538 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.084632 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.084844 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.084932 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.085151 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.085237 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.085481 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.085650 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.085792 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.085886 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.086111 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.086949 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.087080 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.087259 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.087355 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.087432 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.087502 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.087765 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.087888 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.088080 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.088262 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.088393 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.088591 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.088707 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.088911 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.089021 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.089241 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.089330 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.089569 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.089664 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.089892 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.090017 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.090233 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.090323 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.090551 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.090657 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.090868 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.090955 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.091177 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.091263 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.091575 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.091828 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.092219 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.092316 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.092410 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.092492 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.092570 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.092739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.092836 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.093070 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.093165 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.093391 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.093555 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.093710 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.093799 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.094024 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.094131 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.094362 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.094463 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.094683 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.094912 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.095007 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.095232 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.095328 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.095564 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.095658 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.095871 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.095956 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.096173 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.096270 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.096493 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.096627 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.096801 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.096899 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.097100 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.097197 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.097416 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.097510 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.097720 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.097814 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.098030 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.098270 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.098362 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.098616 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.098703 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.098925 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.099030 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.099245 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.099333 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.099564 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.099651 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.099872 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.099966 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.100174 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.100260 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.100496 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.100706 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.100800 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.101058 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.101154 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.101377 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.101472 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.101680 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.101775 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.101985 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.102073 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.102309 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.102397 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.102618 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.102717 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.102924 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.103011 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.103221 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.103308 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.103525 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.103623 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.103823 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.103911 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.104145 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.104243 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.104445 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.104539 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.104742 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.104835 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.105040 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.105128 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.105344 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.105438 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.105642 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.105729 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.105940 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.106027 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.106261 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.106350 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.106558 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.106683 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.106863 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.106950 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.107235 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.107448 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.107808 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.107896 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.107896 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.108050 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.108142 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.108265 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.108440 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.108574 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.108748 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.108881 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.109049 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.109187 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.109369 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.109503 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.109671 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.109808 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.109969 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.110144 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.110307 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.110455 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.110615 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.110767 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.110932 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.111121 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.111237 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.111435 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.111529 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.111741 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.111865 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.112069 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.112184 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.112374 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.112679 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.112817 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.113001 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.113099 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.113316 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.113403 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.113640 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.113727 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.113949 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.114037 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.114277 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.114366 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.114580 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.114669 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.114880 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.114967 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.115201 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.115453 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.115554 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.115788 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.115879 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.116096 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.116182 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.116403 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.116499 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.116707 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.116789 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.117014 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.117101 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.117320 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.117408 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.117622 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.117708 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.117923 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.118009 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.118255 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.118358 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.118561 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.118647 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.118865 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.118966 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.119170 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.119257 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.119473 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.119560 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.119782 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.119883 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.120096 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.120183 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.120410 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.120504 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.120723 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.120820 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.121034 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.121121 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.121345 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.121433 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.121658 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.121757 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.121967 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.122053 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.122297 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.122388 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.122604 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.122768 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.122938 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.123025 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.123267 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.123409 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.123573 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.123738 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.123873 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.124063 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.124382 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.124548 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.124696 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.124859 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.125009 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.125177 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.125324 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.125501 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.125639 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.125812 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.125958 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.126156 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.126311 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.126477 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.126628 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.126788 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.126940 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.127107 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.127416 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.127617 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.127745 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.127934 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.128083 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.128258 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.128407 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.128582 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.128728 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.128896 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.129032 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.129221 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.129317 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.129547 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.129635 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.129863 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.129951 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.130218 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.130371 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.130535 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.130637 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.130825 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.130929 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.131124 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.131235 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.131428 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.131516 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.131726 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.131822 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.132035 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.132123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.132333 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.132421 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.132633 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.132727 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.132938 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.133027 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.133237 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.133325 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.133540 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.133629 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.133840 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.133929 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.134164 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.134257 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.134465 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.134570 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.134761 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.134848 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.135065 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.135151 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.135362 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.135456 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.135658 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.135746 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.135956 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.136049 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.136255 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.136350 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.136549 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.136642 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.136850 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.137003 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.137156 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.137257 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.137466 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.137553 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.137769 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.137858 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.138094 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.138186 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.138509 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.139006 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.139105 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.139188 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.139284 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.139369 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.139508 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.139596 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.139819 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.139914 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.140127 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.140256 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.140461 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.140575 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.140770 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.140872 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.141078 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.141178 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.141384 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.141481 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.141693 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.141800 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.142006 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.142123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.142336 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.142433 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.142660 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.142767 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.143040 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.143140 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.143273 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.143376 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.143595 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.143698 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.143905 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.143991 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.144219 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.144307 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.144529 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.144617 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.144836 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.144929 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.145145 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.145239 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.145454 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.145541 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.145758 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.145852 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.146065 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.146192 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.146389 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.146478 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.146694 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.146781 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.147006 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.147101 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.147312 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.147406 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.147619 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.147714 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.147931 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.148027 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.148244 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.148330 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.148557 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.148651 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.148872 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.148969 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.149177 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.149262 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.149487 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.149573 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.149801 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.149889 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.150145 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.150249 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.150546 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.150673 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.150868 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.150956 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.151191 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.151277 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.151501 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.151589 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.151825 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.151922 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.152126 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.152212 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.152363 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 06:52:36.152450 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.152762 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.153103 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.153443 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.153758 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.154176 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.154511 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.154827 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.155142 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.155450 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:52:36.155695 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 06:52:36.308563 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO dbcounter [None req-97d243df-8d08-4984-89b0-e82402fe0179 None None] Registered counter for database nova_api Sep 13 06:52:36.310965 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO dbcounter [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] Registered counter for database nova_api Sep 13 06:52:36.329204 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG oslo_db.sqlalchemy.engines [None req-97d243df-8d08-4984-89b0-e82402fe0179 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:52:36.331050 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_db.sqlalchemy.engines [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:52:36.336512 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writer thread running {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:52:36.338056 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writer thread running {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:52:36.393300 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.context [None req-97d243df-8d08-4984-89b0-e82402fe0179 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb5fd9cb-18fe-4379-ac3d-53b158992ccd(cell1) {{(pid=105502) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 06:52:36.395920 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.context [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb5fd9cb-18fe-4379-ac3d-53b158992ccd(cell1) {{(pid=105501) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 06:52:36.397148 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-97d243df-8d08-4984-89b0-e82402fe0179 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:36.397616 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-97d243df-8d08-4984-89b0-e82402fe0179 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:36.399218 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-97d243df-8d08-4984-89b0-e82402fe0179 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:36.399770 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:36.399907 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-97d243df-8d08-4984-89b0-e82402fe0179 None None] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:36.400233 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:36.400369 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-97d243df-8d08-4984-89b0-e82402fe0179 None None] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:36.401780 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:36.402346 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-97d243df-8d08-4984-89b0-e82402fe0179 None None] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:36.402483 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:36.402941 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:36.404538 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO dbcounter [None req-97d243df-8d08-4984-89b0-e82402fe0179 None None] Registered counter for database nova_cell0 Sep 13 06:52:36.405559 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:36.407614 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO dbcounter [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] Registered counter for database nova_cell0 Sep 13 06:52:36.408678 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO dbcounter [None req-97d243df-8d08-4984-89b0-e82402fe0179 None None] Registered counter for database nova_cell1 Sep 13 06:52:36.411578 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO dbcounter [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] Registered counter for database nova_cell1 Sep 13 06:52:36.416052 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG oslo_db.sqlalchemy.engines [None req-97d243df-8d08-4984-89b0-e82402fe0179 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:52:36.418451 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG oslo_db.sqlalchemy.engines [None req-97d243df-8d08-4984-89b0-e82402fe0179 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:52:36.419682 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_db.sqlalchemy.engines [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:52:36.423257 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_db.sqlalchemy.engines [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:52:36.424523 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writer thread running {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:52:36.425781 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writer thread running {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:52:36.427220 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writer thread running {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:52:36.565633 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writer thread running {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:52:36.573616 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO dbcounter [None req-97d243df-8d08-4984-89b0-e82402fe0179 None None] Registered counter for database nova_cell0 Sep 13 06:52:36.574918 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO dbcounter [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] Registered counter for database nova_cell0 Sep 13 06:52:36.585793 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG oslo_db.sqlalchemy.engines [None req-97d243df-8d08-4984-89b0-e82402fe0179 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:52:36.587382 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_db.sqlalchemy.engines [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:52:36.590229 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writer thread running {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:52:36.592906 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writer thread running {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:52:36.930967 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: WARNING keystonemiddleware.auth_token [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 06:52:36.931640 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: WARNING keystonemiddleware.auth_token [None req-97d243df-8d08-4984-89b0-e82402fe0179 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 06:52:36.938624 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: WARNING keystonemiddleware.auth_token [None req-97d243df-8d08-4984-89b0-e82402fe0179 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 06:52:36.938764 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: WARNING keystonemiddleware.auth_token [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 06:52:37.281040 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: WARNING keystonemiddleware.auth_token [None req-97d243df-8d08-4984-89b0-e82402fe0179 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 06:52:37.282594 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: WARNING keystonemiddleware.auth_token [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 06:52:37.286923 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: WARNING keystonemiddleware.auth_token [None req-97d243df-8d08-4984-89b0-e82402fe0179 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 06:52:37.288540 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: WARNING keystonemiddleware.auth_token [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 06:52:37.292383 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d39cf719c0 pid: 105502 (default app) Sep 13 06:52:37.293783 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d39cf719c0 pid: 105501 (default app) Sep 13 06:52:37.294526 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-97d243df-8d08-4984-89b0-e82402fe0179 None None] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:37.295939 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-97d243df-8d08-4984-89b0-e82402fe0179 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002001 Sep 13 06:52:37.296324 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Tue Sep 13 06:52:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:53:59.873912 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:53:59.875172 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002048 Sep 13 06:53:59.875552 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 931 bytes} [Tue Sep 13 06:53:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:53:59.886920 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_api:SELECT=3 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:59.888129 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_cell1:SELECT=3 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:59.888922 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_cell0:SELECT=3 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:59.891105 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:00.766044 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-9c30e374-e44d-42af-ae1e-bd858857fa7e admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:00.807549 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-9c30e374-e44d-42af-ae1e-bd858857fa7e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.925787 Sep 13 06:54:00.808651 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 2/3] 10.222.0.25 () {60 vars in 1292 bytes} [Tue Sep 13 06:53:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:54:03.413210 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:03.414223 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-7e7dd9b4-cbf5-43d0-a158-1ea934f20997 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 13 06:54:03.418400 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 2/4] 10.222.0.25 () {54 vars in 931 bytes} [Tue Sep 13 06:54:03 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:54:03.868025 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-9241393f-1353-497b-ba4f-692986f3677b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "ram": 256, "name": "cirros256"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:54:03.917131 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-9241393f-1353-497b-ba4f-692986f3677b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.496301 Sep 13 06:54:03.917917 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 3/5] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Sep 13 06:54:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:54:03.932136 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_api:SELECT=3 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:03.932950 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_cell0:SELECT=3 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:03.935404 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_cell1:SELECT=3 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:03.936164 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:04.140833 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-30ae98f8-0a91-42f8-83a6-c31199f71929 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:54:04.212631 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-30ae98f8-0a91-42f8-83a6-c31199f71929 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285784 Sep 13 06:54:04.213239 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 3/6] 10.222.0.25 () {64 vars in 1336 bytes} [Tue Sep 13 06:54:03 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:54:06.808713 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-9241393f-1353-497b-ba4f-692986f3677b admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:06.809873 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-9241393f-1353-497b-ba4f-692986f3677b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001885 Sep 13 06:54:06.811558 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 4/7] 10.222.0.25 () {54 vars in 931 bytes} [Tue Sep 13 06:54:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:54:07.462419 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-53090581-c275-4b76-9d8d-60d15f6b6ba7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "os-flavor-access:is_public": true, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:54:07.502894 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-53090581-c275-4b76-9d8d-60d15f6b6ba7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.686130 Sep 13 06:54:07.503448 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 4/8] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Sep 13 06:54:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:54:07.515772 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-13053c4e-782a-49c8-979c-4d44e935a691 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:54:07.555255 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-13053c4e-782a-49c8-979c-4d44e935a691 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043134 Sep 13 06:54:07.556093 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 5/9] 10.222.0.25 () {64 vars in 1336 bytes} [Tue Sep 13 06:54:07 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:54:10.245946 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-53090581-c275-4b76-9d8d-60d15f6b6ba7 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:10.247166 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-53090581-c275-4b76-9d8d-60d15f6b6ba7 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001670 Sep 13 06:54:10.247689 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 931 bytes} [Tue Sep 13 06:54:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:54:10.681524 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-d3371b53-9763-4a94-9789-265a381fc3cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds1G", "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d2", "disk": 10, "os-flavor-access:is_public": true}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:54:10.702180 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-d3371b53-9763-4a94-9789-265a381fc3cc admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446067 Sep 13 06:54:10.702742 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 6/11] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Sep 13 06:54:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:54:10.715098 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-14fba636-c6b4-4af0-bff8-5693c3e236a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:54:10.745771 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-14fba636-c6b4-4af0-bff8-5693c3e236a7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034395 Sep 13 06:54:10.746585 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 6/12] 10.222.0.25 () {64 vars in 1336 bytes} [Tue Sep 13 06:54:10 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:54:13.350038 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-d3371b53-9763-4a94-9789-265a381fc3cc admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:13.351730 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-d3371b53-9763-4a94-9789-265a381fc3cc admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002114 Sep 13 06:54:13.352099 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 7/13] 10.222.0.25 () {54 vars in 931 bytes} [Tue Sep 13 06:54:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:54:13.767201 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-2e42df24-f54b-4e94-bb4d-1ede05e1a578 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "d3", "disk": 10, "name": "ds2G"}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:54:13.787305 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-2e42df24-f54b-4e94-bb4d-1ede05e1a578 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.429028 Sep 13 06:54:13.788061 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 7/14] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Sep 13 06:54:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 06:54:13.799906 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-0cf7d4d3-f85f-48d7-88b0-e7c2980e2796 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:54:13.828397 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-0cf7d4d3-f85f-48d7-88b0-e7c2980e2796 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032082 Sep 13 06:54:13.829030 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 8/15] 10.222.0.25 () {64 vars in 1336 bytes} [Tue Sep 13 06:54:13 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:54:16.436272 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-2e42df24-f54b-4e94-bb4d-1ede05e1a578 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:16.437299 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-2e42df24-f54b-4e94-bb4d-1ede05e1a578 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 13 06:54:16.437707 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 8/16] 10.222.0.25 () {54 vars in 931 bytes} [Tue Sep 13 06:54:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:54:16.895142 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-78ff8ae6-afe7-4033-8956-1e831abc1558 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:54:16.919878 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-78ff8ae6-afe7-4033-8956-1e831abc1558 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474120 Sep 13 06:54:16.920724 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 9/17] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Sep 13 06:54:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:54:16.936615 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-1705be06-6e80-4e2f-af78-e2959142b42b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:54:16.968256 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-1705be06-6e80-4e2f-af78-e2959142b42b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036959 Sep 13 06:54:16.968851 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 9/18] 10.222.0.25 () {64 vars in 1336 bytes} [Tue Sep 13 06:54:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:54:19.600270 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-78ff8ae6-afe7-4033-8956-1e831abc1558 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:19.601301 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-78ff8ae6-afe7-4033-8956-1e831abc1558 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Sep 13 06:54:19.601709 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 10/19] 10.222.0.25 () {54 vars in 931 bytes} [Tue Sep 13 06:54:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:54:20.049003 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-e6489275-770f-4e34-9c26-61ca7ee1d2b4 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:20.073857 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-e6489275-770f-4e34-9c26-61ca7ee1d2b4 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.465411 Sep 13 06:54:20.074444 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 10/20] 10.222.0.25 () {60 vars in 1292 bytes} [Tue Sep 13 06:54:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:54:22.851497 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-78ff8ae6-afe7-4033-8956-1e831abc1558 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:22.852513 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-78ff8ae6-afe7-4033-8956-1e831abc1558 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 13 06:54:22.852890 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 11/21] 10.222.0.25 () {54 vars in 931 bytes} [Tue Sep 13 06:54:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:54:23.269968 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-0b1034b5-95ce-40b1-bb23-c7a5ceaea9dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "ram": 512, "id": "1", "swap": 0, "rxtx_factor": 1.0, "disk": 1}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:54:23.292400 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-0b1034b5-95ce-40b1-bb23-c7a5ceaea9dc admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.433252 Sep 13 06:54:23.293048 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 11/22] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Sep 13 06:54:22 2022] POST /compute/v2.1/flavors => generated 402 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:54:23.305939 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-e07f2b2a-acc4-4d17-8e59-292cdb64a118 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:54:23.337174 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-e07f2b2a-acc4-4d17-8e59-292cdb64a118 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035041 Sep 13 06:54:23.337742 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 12/23] 10.222.0.25 () {64 vars in 1333 bytes} [Tue Sep 13 06:54:23 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:54:25.955431 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-0b1034b5-95ce-40b1-bb23-c7a5ceaea9dc admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:25.956446 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-0b1034b5-95ce-40b1-bb23-c7a5ceaea9dc admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 13 06:54:25.956817 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 12/24] 10.222.0.25 () {54 vars in 931 bytes} [Tue Sep 13 06:54:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:54:26.343517 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-e83096e4-0c0b-4a4a-9da4-98c0351ae67e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.small", "id": "2", "vcpus": 1}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:54:26.364004 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-e83096e4-0c0b-4a4a-9da4-98c0351ae67e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.400821 Sep 13 06:54:26.364708 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 13/25] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Sep 13 06:54:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 06:54:26.378153 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-f0b23cd8-5d12-4a62-8b50-18cd64ca7522 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:54:26.403930 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-f0b23cd8-5d12-4a62-8b50-18cd64ca7522 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030626 Sep 13 06:54:26.404509 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 13/26] 10.222.0.25 () {64 vars in 1333 bytes} [Tue Sep 13 06:54:26 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:54:29.057421 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-e83096e4-0c0b-4a4a-9da4-98c0351ae67e admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:29.058708 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-e83096e4-0c0b-4a4a-9da4-98c0351ae67e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001918 Sep 13 06:54:29.062131 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 14/27] 10.222.0.25 () {54 vars in 931 bytes} [Tue Sep 13 06:54:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:54:29.502843 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-eb0aea95-12c3-4064-8172-19933eb34994 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 4096, "id": "3", "disk": 40, "name": "m1.medium"}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:54:29.532313 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-eb0aea95-12c3-4064-8172-19933eb34994 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.466599 Sep 13 06:54:29.532971 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 14/28] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Sep 13 06:54:29 2022] POST /compute/v2.1/flavors => generated 406 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:54:29.546105 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-1cec4a0a-3443-4b0d-b504-9209c6f8e478 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:54:29.581012 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-1cec4a0a-3443-4b0d-b504-9209c6f8e478 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039529 Sep 13 06:54:29.586255 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 15/29] 10.222.0.25 () {64 vars in 1333 bytes} [Tue Sep 13 06:54:29 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:54:32.209223 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-eb0aea95-12c3-4064-8172-19933eb34994 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:32.210434 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-eb0aea95-12c3-4064-8172-19933eb34994 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Sep 13 06:54:32.211223 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 15/30] 10.222.0.25 () {54 vars in 931 bytes} [Tue Sep 13 06:54:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:54:32.673982 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-eef28f7f-7024-4a39-87eb-0fd9f022e943 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "disk": 80, "rxtx_factor": 1.0, "vcpus": 4, "id": "4", "name": "m1.large"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:54:32.680853 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:32.701492 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-eef28f7f-7024-4a39-87eb-0fd9f022e943 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.484058 Sep 13 06:54:32.702050 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 16/31] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Sep 13 06:54:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:54:32.714099 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-572ed895-0d75-4122-b48f-a810a160486a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:54:32.738834 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-572ed895-0d75-4122-b48f-a810a160486a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028392 Sep 13 06:54:32.739428 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 16/32] 10.222.0.25 () {64 vars in 1333 bytes} [Tue Sep 13 06:54:32 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:54:35.348170 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-eef28f7f-7024-4a39-87eb-0fd9f022e943 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:35.349807 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-eef28f7f-7024-4a39-87eb-0fd9f022e943 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002091 Sep 13 06:54:35.350241 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 17/33] 10.222.0.25 () {54 vars in 931 bytes} [Tue Sep 13 06:54:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:54:35.805224 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-2efea848-cb11-44d5-bd7e-c31ed455c789 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "disk": 160, "swap": 0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "id": "5", "rxtx_factor": 1.0}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:54:35.812221 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:35.829876 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-2efea848-cb11-44d5-bd7e-c31ed455c789 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.472981 Sep 13 06:54:35.830865 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 17/34] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Sep 13 06:54:35 2022] POST /compute/v2.1/flavors => generated 408 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:54:35.843264 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-848358f1-ed48-441e-8773-93f04d5001b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:54:35.870804 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-848358f1-ed48-441e-8773-93f04d5001b5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031622 Sep 13 06:54:35.871576 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 18/35] 10.222.0.25 () {64 vars in 1333 bytes} [Tue Sep 13 06:54:35 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:54:52.584701 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-2efea848-cb11-44d5-bd7e-c31ed455c789 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:52.586223 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-2efea848-cb11-44d5-bd7e-c31ed455c789 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002384 Sep 13 06:54:52.586874 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 18/36] 10.222.0.25 () {54 vars in 931 bytes} [Tue Sep 13 06:54:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:54:52.601355 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:53.189252 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-ff758a29-9c4c-4b75-8f70-2b6e165208c6 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:53.211168 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-ff758a29-9c4c-4b75-8f70-2b6e165208c6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.615440 Sep 13 06:54:53.211709 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 19/37] 10.222.0.25 () {60 vars in 1292 bytes} [Tue Sep 13 06:54:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:54:54.530557 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-2efea848-cb11-44d5-bd7e-c31ed455c789 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:54.531569 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-2efea848-cb11-44d5-bd7e-c31ed455c789 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Sep 13 06:54:54.532006 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 19/38] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Sep 13 06:54:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:54:55.092428 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-6ee03e06-702d-4431-a2ed-3c4b9d5dbe39 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:55.097827 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.wsgi [None req-6ee03e06-702d-4431-a2ed-3c4b9d5dbe39 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-6ee03e06-702d-4431-a2ed-3c4b9d5dbe39 admin admin] Request method failure captured: Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Accept: application/json Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Accept-Encoding: gzip, deflate Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Connection: keep-alive Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Content-Length: 0 Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Host: 10.222.0.25 Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Openstack-Api-Version: compute 2.92 Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Openstack-System-Scope: None Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: User-Agent: python-novaclient Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Auth-Token: gAAAAABjICk-Uz6tc05U1swGzRyLfifP-xg_WtAoJVCArJKWuYsbTwh_cHejeaI-ZHT4o4kQzpqYiJrVQHqi7EhG1lEizRGSmu06iWWqJSjLwmjZwze8F4jvqXb4FYGTdz65oeHlXro1jTsUMoXLNtkpUUfPi1gL7v2g-KpPjEohOVGXB2VKCCw Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Domain-Id: None Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Domain-Name: None Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Identity-Status: Confirmed Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Is-Admin-Project: True Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Project-Domain-Id: default Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Project-Domain-Name: Default Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Project-Id: 2becfff2f1104b709c0a7babcac266dd Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Project-Name: admin Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Role: admin,reader,member Sep 13 06:54:55.101215 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Roles: admin,reader,member Sep 13 06:54:55.102760 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2becfff2f1104b709c0a7babcac266dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2becfff2f1104b709c0a7babcac266dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2becfff2f1104b709c0a7babcac266dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2becfff2f1104b709c0a7babcac266dd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 06:54:55.102760 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Tenant: admin Sep 13 06:54:55.102760 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Tenant-Id: 2becfff2f1104b709c0a7babcac266dd Sep 13 06:54:55.102760 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Tenant-Name: admin Sep 13 06:54:55.102760 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-User: admin Sep 13 06:54:55.102760 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-User-Domain-Id: default Sep 13 06:54:55.102760 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-User-Domain-Name: Default Sep 13 06:54:55.102760 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-User-Id: d3bdb62de62349b6b321bb705e25f4be Sep 13 06:54:55.102760 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-User-Name: admin Sep 13 06:54:55.102760 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: method: > Sep 13 06:54:55.102760 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: exception: Flavor 42 could not be found. Sep 13 06:54:55.102760 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: action_args: {'id': '42'} Sep 13 06:54:55.102760 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:54:55.102760 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:55.103714 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 06:54:55.103714 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 06:54:55.103714 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 06:54:55.103714 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 06:54:55.103714 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 06:54:55.103714 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 06:54:55.103714 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 06:54:55.103714 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 06:54:55.103714 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 06:54:55.103714 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:54:55.103714 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 06:54:55.103714 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 06:54:55.103714 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 06:54:55.103714 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 13 06:54:55.103714 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:55.103714 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 13 06:54:55.103714 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:55.103714 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:55.103714 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:55.105282 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:54:55.105282 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:54:55.105282 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:54:55.105282 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:54:55.105282 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 06:54:55.105282 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:54:55.105282 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 06:54:55.105282 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 13 06:54:55.105282 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:55.105282 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 13 06:54:55.105282 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:55.105282 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:55.105282 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:55.105282 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:54:55.105282 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:54:55.105282 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 06:54:55.105282 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 13 06:54:55.105282 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-6ee03e06-702d-4431-a2ed-3c4b9d5dbe39 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:54:55.106850 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-6ee03e06-702d-4431-a2ed-3c4b9d5dbe39 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.430631 Sep 13 06:54:55.106850 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 20/39] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Sep 13 06:54:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:55.114052 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-8dc6f1cd-8ddb-4fb2-9f17-35dacbaea462 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:55.140904 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-8dc6f1cd-8ddb-4fb2-9f17-35dacbaea462 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.030735 Sep 13 06:54:55.141404 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 20/40] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Sep 13 06:54:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:54:55.152815 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-d3c2561e-295d-442c-92a8-755c396a0afb admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:55.174638 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-d3c2561e-295d-442c-92a8-755c396a0afb admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026733 Sep 13 06:54:55.175158 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 21/41] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Sep 13 06:54:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 06:54:55.185763 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-a718d320-8672-4056-ad34-a1cf05fc6967 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:55.191758 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.wsgi [None req-a718d320-8672-4056-ad34-a1cf05fc6967 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-a718d320-8672-4056-ad34-a1cf05fc6967 admin admin] Request method failure captured: Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Accept: application/json Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Accept-Encoding: gzip, deflate Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Connection: keep-alive Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Content-Length: 0 Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Host: 10.222.0.25 Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Openstack-Api-Version: compute 2.92 Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Openstack-System-Scope: None Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: User-Agent: python-novaclient Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Auth-Token: gAAAAABjICk-Uz6tc05U1swGzRyLfifP-xg_WtAoJVCArJKWuYsbTwh_cHejeaI-ZHT4o4kQzpqYiJrVQHqi7EhG1lEizRGSmu06iWWqJSjLwmjZwze8F4jvqXb4FYGTdz65oeHlXro1jTsUMoXLNtkpUUfPi1gL7v2g-KpPjEohOVGXB2VKCCw Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Domain-Id: None Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Domain-Name: None Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Identity-Status: Confirmed Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Is-Admin-Project: True Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Project-Domain-Id: default Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Project-Domain-Name: Default Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Project-Id: 2becfff2f1104b709c0a7babcac266dd Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Project-Name: admin Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Role: admin,reader,member Sep 13 06:54:55.195123 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Roles: admin,reader,member Sep 13 06:54:55.196638 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2becfff2f1104b709c0a7babcac266dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2becfff2f1104b709c0a7babcac266dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2becfff2f1104b709c0a7babcac266dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2becfff2f1104b709c0a7babcac266dd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 06:54:55.196638 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Tenant: admin Sep 13 06:54:55.196638 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Tenant-Id: 2becfff2f1104b709c0a7babcac266dd Sep 13 06:54:55.196638 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Tenant-Name: admin Sep 13 06:54:55.196638 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-User: admin Sep 13 06:54:55.196638 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-User-Domain-Id: default Sep 13 06:54:55.196638 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-User-Domain-Name: Default Sep 13 06:54:55.196638 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-User-Id: d3bdb62de62349b6b321bb705e25f4be Sep 13 06:54:55.196638 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-User-Name: admin Sep 13 06:54:55.196638 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: method: > Sep 13 06:54:55.196638 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: exception: Flavor 42 could not be found. Sep 13 06:54:55.196638 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: action_args: {'id': '42'} Sep 13 06:54:55.196638 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:54:55.196638 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:55.197711 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 06:54:55.197711 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 06:54:55.197711 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 06:54:55.197711 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 06:54:55.197711 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 06:54:55.197711 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 06:54:55.197711 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 06:54:55.197711 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 06:54:55.197711 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 06:54:55.197711 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:54:55.197711 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 06:54:55.197711 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 06:54:55.197711 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 06:54:55.197711 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 13 06:54:55.197711 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:55.197711 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 13 06:54:55.197711 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:55.197711 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:55.197711 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:55.199195 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:54:55.199195 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:54:55.199195 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:54:55.199195 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:54:55.199195 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 06:54:55.199195 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:54:55.199195 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 06:54:55.199195 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 13 06:54:55.199195 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:55.199195 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 13 06:54:55.199195 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:55.199195 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:55.199195 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:55.199195 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:54:55.199195 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:54:55.199195 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 06:54:55.199195 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 13 06:54:55.199195 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-a718d320-8672-4056-ad34-a1cf05fc6967 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:54:55.200501 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-a718d320-8672-4056-ad34-a1cf05fc6967 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014996 Sep 13 06:54:55.200501 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 21/42] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Sep 13 06:54:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:56.443908 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-d3c2561e-295d-442c-92a8-755c396a0afb admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:56.444929 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-d3c2561e-295d-442c-92a8-755c396a0afb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 13 06:54:56.445329 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 22/43] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Sep 13 06:54:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:54:57.014596 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-27040784-8547-4136-85eb-69a763a22fa6 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:57.019774 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.wsgi [None req-27040784-8547-4136-85eb-69a763a22fa6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-27040784-8547-4136-85eb-69a763a22fa6 admin admin] Request method failure captured: Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Accept: application/json Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Accept-Encoding: gzip, deflate Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Connection: keep-alive Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Content-Length: 0 Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Host: 10.222.0.25 Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Openstack-Api-Version: compute 2.92 Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Openstack-System-Scope: None Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: User-Agent: python-novaclient Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Auth-Token: gAAAAABjIClAMw7H9WFLxoO60_BWAy2dK5RWu0UTnM5sQKRRwLgyUvl6g-KcBN_Q6Ga_saXKMmxW_g8TMDHiatG-IAUtNOOnzvxuz8Bsb3YzsyXNmHo5WeYfsbamsDH0aDIeo3rATGbgPusThI_185gZtGswhzMb3s_A_B9C5BjQeefVD69cX2A Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Domain-Id: None Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Domain-Name: None Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Identity-Status: Confirmed Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Is-Admin-Project: True Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Project-Domain-Id: default Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Project-Domain-Name: Default Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Project-Id: 2becfff2f1104b709c0a7babcac266dd Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Project-Name: admin Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Role: admin,reader,member Sep 13 06:54:57.021290 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Roles: admin,reader,member Sep 13 06:54:57.022853 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2becfff2f1104b709c0a7babcac266dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2becfff2f1104b709c0a7babcac266dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2becfff2f1104b709c0a7babcac266dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2becfff2f1104b709c0a7babcac266dd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 06:54:57.022853 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Tenant: admin Sep 13 06:54:57.022853 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Tenant-Id: 2becfff2f1104b709c0a7babcac266dd Sep 13 06:54:57.022853 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Tenant-Name: admin Sep 13 06:54:57.022853 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-User: admin Sep 13 06:54:57.022853 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-User-Domain-Id: default Sep 13 06:54:57.022853 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-User-Domain-Name: Default Sep 13 06:54:57.022853 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-User-Id: d3bdb62de62349b6b321bb705e25f4be Sep 13 06:54:57.022853 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-User-Name: admin Sep 13 06:54:57.022853 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: method: > Sep 13 06:54:57.022853 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: exception: Flavor 84 could not be found. Sep 13 06:54:57.022853 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: action_args: {'id': '84'} Sep 13 06:54:57.022853 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:54:57.022853 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:57.023964 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 06:54:57.023964 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 06:54:57.023964 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 06:54:57.023964 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 06:54:57.023964 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 06:54:57.023964 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 06:54:57.023964 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 06:54:57.023964 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 06:54:57.023964 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 06:54:57.023964 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:54:57.023964 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 06:54:57.023964 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 06:54:57.023964 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 06:54:57.023964 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 13 06:54:57.023964 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:57.023964 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 13 06:54:57.023964 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:57.023964 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:57.023964 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:57.025655 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:54:57.025655 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:54:57.025655 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:54:57.025655 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:54:57.025655 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 06:54:57.025655 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:54:57.025655 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 06:54:57.025655 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 13 06:54:57.025655 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:57.025655 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 13 06:54:57.025655 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:57.025655 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:57.025655 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:57.025655 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:54:57.025655 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:54:57.025655 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 06:54:57.025655 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 13 06:54:57.025655 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-27040784-8547-4136-85eb-69a763a22fa6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:54:57.027577 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-27040784-8547-4136-85eb-69a763a22fa6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.437188 Sep 13 06:54:57.027577 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 22/44] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Sep 13 06:54:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:57.037375 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-bb0bcb52-9d96-4a96-af78-58f271b749a2 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:57.055326 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-bb0bcb52-9d96-4a96-af78-58f271b749a2 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.023931 Sep 13 06:54:57.055858 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 23/45] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Sep 13 06:54:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:54:57.066429 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-53052831-ac10-4536-aa3d-a4fe7c0f7a01 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:57.082903 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-53052831-ac10-4536-aa3d-a4fe7c0f7a01 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020024 Sep 13 06:54:57.083434 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 23/46] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Sep 13 06:54:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:54:57.095640 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-db6aa043-6a0d-4b38-9ff4-b433387de7b6 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:57.103435 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.wsgi [None req-db6aa043-6a0d-4b38-9ff4-b433387de7b6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-db6aa043-6a0d-4b38-9ff4-b433387de7b6 admin admin] Request method failure captured: Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Accept: application/json Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Accept-Encoding: gzip, deflate Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Connection: keep-alive Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Content-Length: 0 Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Host: 10.222.0.25 Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Openstack-Api-Version: compute 2.92 Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Openstack-System-Scope: None Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: User-Agent: python-novaclient Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Auth-Token: gAAAAABjIClAMw7H9WFLxoO60_BWAy2dK5RWu0UTnM5sQKRRwLgyUvl6g-KcBN_Q6Ga_saXKMmxW_g8TMDHiatG-IAUtNOOnzvxuz8Bsb3YzsyXNmHo5WeYfsbamsDH0aDIeo3rATGbgPusThI_185gZtGswhzMb3s_A_B9C5BjQeefVD69cX2A Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Domain-Id: None Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Domain-Name: None Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Identity-Status: Confirmed Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Is-Admin-Project: True Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Project-Domain-Id: default Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Project-Domain-Name: Default Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Project-Id: 2becfff2f1104b709c0a7babcac266dd Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Project-Name: admin Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Role: admin,reader,member Sep 13 06:54:57.105739 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Roles: admin,reader,member Sep 13 06:54:57.107661 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2becfff2f1104b709c0a7babcac266dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2becfff2f1104b709c0a7babcac266dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2becfff2f1104b709c0a7babcac266dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2becfff2f1104b709c0a7babcac266dd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 06:54:57.107661 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Tenant: admin Sep 13 06:54:57.107661 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Tenant-Id: 2becfff2f1104b709c0a7babcac266dd Sep 13 06:54:57.107661 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Tenant-Name: admin Sep 13 06:54:57.107661 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-User: admin Sep 13 06:54:57.107661 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-User-Domain-Id: default Sep 13 06:54:57.107661 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-User-Domain-Name: Default Sep 13 06:54:57.107661 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-User-Id: d3bdb62de62349b6b321bb705e25f4be Sep 13 06:54:57.107661 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-User-Name: admin Sep 13 06:54:57.107661 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: method: > Sep 13 06:54:57.107661 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: exception: Flavor 84 could not be found. Sep 13 06:54:57.107661 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: action_args: {'id': '84'} Sep 13 06:54:57.107661 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:54:57.107661 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:57.108581 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 06:54:57.108581 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 06:54:57.108581 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 06:54:57.108581 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 06:54:57.108581 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 06:54:57.108581 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 06:54:57.108581 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 06:54:57.108581 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 06:54:57.108581 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 06:54:57.108581 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:54:57.108581 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 06:54:57.108581 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 06:54:57.108581 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 06:54:57.108581 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 13 06:54:57.108581 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:57.108581 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 13 06:54:57.108581 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:57.108581 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:57.108581 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:57.110058 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:54:57.110058 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:54:57.110058 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:54:57.110058 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:54:57.110058 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 06:54:57.110058 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:54:57.110058 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 06:54:57.110058 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 13 06:54:57.110058 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:57.110058 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 13 06:54:57.110058 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:57.110058 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:57.110058 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:57.110058 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:54:57.110058 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:54:57.110058 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 06:54:57.110058 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 13 06:54:57.110058 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-db6aa043-6a0d-4b38-9ff4-b433387de7b6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:54:57.111413 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-db6aa043-6a0d-4b38-9ff4-b433387de7b6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.017382 Sep 13 06:54:57.111413 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 24/47] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Sep 13 06:54:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:58.357823 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-53052831-ac10-4536-aa3d-a4fe7c0f7a01 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:58.358868 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-53052831-ac10-4536-aa3d-a4fe7c0f7a01 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 13 06:54:58.359266 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 24/48] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Sep 13 06:54:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:54:58.939900 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-7b41bbc6-a7a3-4b3b-a59e-8b949e03ec57 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:58.945987 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.wsgi [None req-7b41bbc6-a7a3-4b3b-a59e-8b949e03ec57 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-7b41bbc6-a7a3-4b3b-a59e-8b949e03ec57 admin admin] Request method failure captured: Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Accept: application/json Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Accept-Encoding: gzip, deflate Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Connection: keep-alive Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Content-Length: 0 Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Host: 10.222.0.25 Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Openstack-Api-Version: compute 2.92 Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Openstack-System-Scope: None Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: User-Agent: python-novaclient Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Auth-Token: gAAAAABjIClCLOvE7Oq6mCKOBVDLwxUlaiDo13oph1f8CXW6b5MNZg7fVV-Bl9fXAcPdXjIZQoUJAoZyjLO-CR6n87fjOszPZuX7jtzFNRhXd5p-hhT-TX3GfnfXdTLzfWahQ8GeOEhJkFrpInL7ZNcTf803FnguTBl3M2j-BhNif3rQ-g475Uw Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Domain-Id: None Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Domain-Name: None Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Identity-Status: Confirmed Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Is-Admin-Project: True Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Project-Domain-Id: default Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Project-Domain-Name: Default Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Project-Id: 2becfff2f1104b709c0a7babcac266dd Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Project-Name: admin Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Role: admin,reader,member Sep 13 06:54:58.947500 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Roles: admin,reader,member Sep 13 06:54:58.948931 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2becfff2f1104b709c0a7babcac266dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2becfff2f1104b709c0a7babcac266dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2becfff2f1104b709c0a7babcac266dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2becfff2f1104b709c0a7babcac266dd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 06:54:58.948931 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Tenant: admin Sep 13 06:54:58.948931 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Tenant-Id: 2becfff2f1104b709c0a7babcac266dd Sep 13 06:54:58.948931 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-Tenant-Name: admin Sep 13 06:54:58.948931 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-User: admin Sep 13 06:54:58.948931 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-User-Domain-Id: default Sep 13 06:54:58.948931 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-User-Domain-Name: Default Sep 13 06:54:58.948931 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-User-Id: d3bdb62de62349b6b321bb705e25f4be Sep 13 06:54:58.948931 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: X-User-Name: admin Sep 13 06:54:58.948931 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: method: > Sep 13 06:54:58.948931 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: exception: Flavor 451 could not be found. Sep 13 06:54:58.948931 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: action_args: {'id': '451'} Sep 13 06:54:58.948931 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:54:58.948931 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:58.949747 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 06:54:58.949747 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 06:54:58.949747 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 06:54:58.949747 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 06:54:58.949747 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 06:54:58.949747 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 06:54:58.949747 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 06:54:58.949747 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 06:54:58.949747 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 06:54:58.949747 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:54:58.949747 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 06:54:58.949747 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 06:54:58.949747 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 06:54:58.949747 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 13 06:54:58.949747 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:58.949747 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 13 06:54:58.949747 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:58.949747 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:58.949747 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:58.951528 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:54:58.951528 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:54:58.951528 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:54:58.951528 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:54:58.951528 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 06:54:58.951528 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:54:58.951528 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 06:54:58.951528 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 13 06:54:58.951528 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:58.951528 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 13 06:54:58.951528 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:58.951528 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:58.951528 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:58.951528 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:54:58.951528 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:54:58.951528 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 06:54:58.951528 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 13 06:54:58.951528 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-7b41bbc6-a7a3-4b3b-a59e-8b949e03ec57 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:54:58.952540 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-7b41bbc6-a7a3-4b3b-a59e-8b949e03ec57 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.453061 Sep 13 06:54:58.952540 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 25/49] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Sep 13 06:54:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 454 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:58.961671 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-39599989-504f-4dfe-9f6a-4570720fda83 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:58.984660 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-39599989-504f-4dfe-9f6a-4570720fda83 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028657 Sep 13 06:54:58.985219 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 25/50] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Sep 13 06:54:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:54:59.000800 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-75b9b16f-57ff-49ef-8820-37569bc17afe admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:59.018387 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-75b9b16f-57ff-49ef-8820-37569bc17afe admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.023381 Sep 13 06:54:59.018910 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 26/51] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Sep 13 06:54:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:54:59.028345 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-c2ec283e-04ec-4e8b-8824-7c5541240233 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:59.033509 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.wsgi [None req-c2ec283e-04ec-4e8b-8824-7c5541240233 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-c2ec283e-04ec-4e8b-8824-7c5541240233 admin admin] Request method failure captured: Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Accept: application/json Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Accept-Encoding: gzip, deflate Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Connection: keep-alive Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Content-Length: 0 Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Host: 10.222.0.25 Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Openstack-Api-Version: compute 2.92 Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Openstack-System-Scope: None Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: User-Agent: python-novaclient Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Auth-Token: gAAAAABjIClCLOvE7Oq6mCKOBVDLwxUlaiDo13oph1f8CXW6b5MNZg7fVV-Bl9fXAcPdXjIZQoUJAoZyjLO-CR6n87fjOszPZuX7jtzFNRhXd5p-hhT-TX3GfnfXdTLzfWahQ8GeOEhJkFrpInL7ZNcTf803FnguTBl3M2j-BhNif3rQ-g475Uw Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Domain-Id: None Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Domain-Name: None Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Identity-Status: Confirmed Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Is-Admin-Project: True Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Project-Domain-Id: default Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Project-Domain-Name: Default Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Project-Id: 2becfff2f1104b709c0a7babcac266dd Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Project-Name: admin Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Role: admin,reader,member Sep 13 06:54:59.035055 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Roles: admin,reader,member Sep 13 06:54:59.036463 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2becfff2f1104b709c0a7babcac266dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2becfff2f1104b709c0a7babcac266dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2becfff2f1104b709c0a7babcac266dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2becfff2f1104b709c0a7babcac266dd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 06:54:59.036463 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Tenant: admin Sep 13 06:54:59.036463 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Tenant-Id: 2becfff2f1104b709c0a7babcac266dd Sep 13 06:54:59.036463 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-Tenant-Name: admin Sep 13 06:54:59.036463 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-User: admin Sep 13 06:54:59.036463 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-User-Domain-Id: default Sep 13 06:54:59.036463 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-User-Domain-Name: Default Sep 13 06:54:59.036463 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-User-Id: d3bdb62de62349b6b321bb705e25f4be Sep 13 06:54:59.036463 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: X-User-Name: admin Sep 13 06:54:59.036463 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: method: > Sep 13 06:54:59.036463 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: exception: Flavor 451 could not be found. Sep 13 06:54:59.036463 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: action_args: {'id': '451'} Sep 13 06:54:59.036463 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:54:59.036463 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:59.037308 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 06:54:59.037308 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 06:54:59.037308 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 06:54:59.037308 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 06:54:59.037308 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 06:54:59.037308 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 06:54:59.037308 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 06:54:59.037308 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 06:54:59.037308 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 06:54:59.037308 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:54:59.037308 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 06:54:59.037308 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 06:54:59.037308 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 06:54:59.037308 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 13 06:54:59.037308 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:59.037308 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 13 06:54:59.037308 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:59.037308 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:59.037308 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:59.038719 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:54:59.038719 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:54:59.038719 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:54:59.038719 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:54:59.038719 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 06:54:59.038719 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:54:59.038719 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 06:54:59.038719 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 13 06:54:59.038719 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:59.038719 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 13 06:54:59.038719 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:59.038719 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:59.038719 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:59.038719 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:54:59.038719 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:54:59.038719 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 06:54:59.038719 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 13 06:54:59.038719 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-c2ec283e-04ec-4e8b-8824-7c5541240233 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:54:59.040026 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-c2ec283e-04ec-4e8b-8824-7c5541240233 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011619 Sep 13 06:54:59.040026 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 26/52] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Sep 13 06:54:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 06:55:00.269127 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-75b9b16f-57ff-49ef-8820-37569bc17afe admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:55:00.270200 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-75b9b16f-57ff-49ef-8820-37569bc17afe admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 13 06:55:00.270594 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 27/53] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Sep 13 06:55:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:55:00.857988 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-0aea8177-bc06-4e23-a3c0-5f3b67570244 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:55:00.880292 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-0aea8177-bc06-4e23-a3c0-5f3b67570244 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.473479 Sep 13 06:55:00.880833 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 27/54] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Sep 13 06:55:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:55:02.125024 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-75b9b16f-57ff-49ef-8820-37569bc17afe admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:55:02.125995 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-75b9b16f-57ff-49ef-8820-37569bc17afe admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Sep 13 06:55:02.126445 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 28/55] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Sep 13 06:55:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:55:02.689820 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-4a8c9615-dbec-4140-8408-f01c46efcf38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:55:02.711838 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-4a8c9615-dbec-4140-8408-f01c46efcf38 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.448424 Sep 13 06:55:02.712390 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 28/56] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Sep 13 06:55:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:55:03.958576 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-75b9b16f-57ff-49ef-8820-37569bc17afe admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:55:03.959619 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-75b9b16f-57ff-49ef-8820-37569bc17afe admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Sep 13 06:55:03.960000 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 29/57] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Sep 13 06:55:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:55:04.529025 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-d4bfe34e-4075-44ab-9435-8d59973ce839 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:55:04.553381 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-d4bfe34e-4075-44ab-9435-8d59973ce839 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.453505 Sep 13 06:55:04.553958 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 29/58] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Sep 13 06:55:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:55:05.795877 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-75b9b16f-57ff-49ef-8820-37569bc17afe admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:55:05.796887 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-75b9b16f-57ff-49ef-8820-37569bc17afe admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 13 06:55:05.797265 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 30/59] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Sep 13 06:55:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:55:06.381276 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-211c614a-2625-4e29-8831-5dd83bda046a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:55:06.402972 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-211c614a-2625-4e29-8831-5dd83bda046a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.468045 Sep 13 06:55:06.403518 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 30/60] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Sep 13 06:55:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:55:07.635878 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-75b9b16f-57ff-49ef-8820-37569bc17afe admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:55:07.636887 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-75b9b16f-57ff-49ef-8820-37569bc17afe admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 13 06:55:07.637281 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 31/61] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Sep 13 06:55:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:55:08.359201 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-0dc3784a-3fce-4741-a46f-731303e4ab3e admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:55:08.386013 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-0dc3784a-3fce-4741-a46f-731303e4ab3e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.611867 Sep 13 06:55:08.386602 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 31/62] 10.222.0.25 () {60 vars in 1202 bytes} [Tue Sep 13 06:55:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:56:05.849843 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-75b9b16f-57ff-49ef-8820-37569bc17afe admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:56:05.850886 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-75b9b16f-57ff-49ef-8820-37569bc17afe admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Sep 13 06:56:05.851322 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 32/63] 10.222.0.25 () {54 vars in 931 bytes} [Tue Sep 13 06:56:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:56:05.862902 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:56:06.308812 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-4c1dd896-1ec0-4fc0-a614-f5dc13f1dd47 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:56:06.329810 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-4c1dd896-1ec0-4fc0-a614-f5dc13f1dd47 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.471601 Sep 13 06:56:06.330422 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 32/64] 10.222.0.25 () {60 vars in 1292 bytes} [Tue Sep 13 06:56:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:56:06.351881 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_api:SELECT=14 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:56:06.355830 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-cf81dafa-8a39-4a77-bcb9-c9638ff40df1 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:56:06.363608 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-cf81dafa-8a39-4a77-bcb9-c9638ff40df1 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013324 Sep 13 06:56:06.364134 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 33/65] 10.222.0.25 () {60 vars in 1283 bytes} [Tue Sep 13 06:56:06 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:56:06.379105 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-e632d813-886b-44b0-a344-ac2cd6b4d883 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:56:06.390091 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-e632d813-886b-44b0-a344-ac2cd6b4d883 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016826 Sep 13 06:56:06.390713 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 33/66] 10.222.0.25 () {60 vars in 1286 bytes} [Tue Sep 13 06:56:06 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:56:06.402496 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-48c85999-d847-4d46-b773-d0f57a07d31a admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:56:06.409898 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-48c85999-d847-4d46-b773-d0f57a07d31a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010985 Sep 13 06:56:06.410440 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 34/67] 10.222.0.25 () {60 vars in 1286 bytes} [Tue Sep 13 06:56:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:56:06.422015 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-1a30f7cb-e480-49e5-9a52-78f76eb0ec3b admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:56:06.429365 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-1a30f7cb-e480-49e5-9a52-78f76eb0ec3b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010986 Sep 13 06:56:06.429857 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 34/68] 10.222.0.25 () {60 vars in 1283 bytes} [Tue Sep 13 06:56:06 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:59:03.694345 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-48c85999-d847-4d46-b773-d0f57a07d31a admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:59:03.695396 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-48c85999-d847-4d46-b773-d0f57a07d31a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Sep 13 06:59:03.695817 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 35/69] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Sep 13 06:59:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:59:03.837178 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_api:SELECT=6 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:59:04.018049 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-d3ba4b51-2a24-444a-a285-2fd7194d50e0 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:59:04.025368 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-d3ba4b51-2a24-444a-a285-2fd7194d50e0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:59:04.026028 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-d3ba4b51-2a24-444a-a285-2fd7194d50e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:59:04.026691 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-d3ba4b51-2a24-444a-a285-2fd7194d50e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:59:04.027768 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-d3ba4b51-2a24-444a-a285-2fd7194d50e0 admin admin] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:59:04.028390 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-d3ba4b51-2a24-444a-a285-2fd7194d50e0 admin admin] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:59:04.028902 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-d3ba4b51-2a24-444a-a285-2fd7194d50e0 admin admin] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:59:04.063839 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-d3ba4b51-2a24-444a-a285-2fd7194d50e0 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.228036 Sep 13 06:59:04.064380 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 35/70] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Sep 13 06:59:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:59:05.147818 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-48c85999-d847-4d46-b773-d0f57a07d31a admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:59:05.148883 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-48c85999-d847-4d46-b773-d0f57a07d31a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 13 06:59:05.149481 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 36/71] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Sep 13 06:59:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:59:05.346740 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-499cd82a-e7c0-4e4b-ae52-bb4670e24a61 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:59:05.350206 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-499cd82a-e7c0-4e4b-ae52-bb4670e24a61 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:59:05.350678 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-499cd82a-e7c0-4e4b-ae52-bb4670e24a61 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:59:05.351126 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-499cd82a-e7c0-4e4b-ae52-bb4670e24a61 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:59:05.351827 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-499cd82a-e7c0-4e4b-ae52-bb4670e24a61 admin admin] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:59:05.352502 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-499cd82a-e7c0-4e4b-ae52-bb4670e24a61 admin admin] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:59:05.352910 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-499cd82a-e7c0-4e4b-ae52-bb4670e24a61 admin admin] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:59:05.372024 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-499cd82a-e7c0-4e4b-ae52-bb4670e24a61 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.084994 Sep 13 06:59:05.372559 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 36/72] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Sep 13 06:59:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:59:16.903058 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-48c85999-d847-4d46-b773-d0f57a07d31a admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:59:16.904067 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-48c85999-d847-4d46-b773-d0f57a07d31a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 13 06:59:16.904469 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 37/73] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Sep 13 06:59:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:59:17.051004 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_cell0:SELECT=4 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:59:17.051890 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_cell1:SELECT=4 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:59:17.052676 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_api:SELECT=8 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:59:17.103679 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-5f153896-8631-406d-8b7a-bcbbdff9aab0 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:59:17.107132 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-5f153896-8631-406d-8b7a-bcbbdff9aab0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:59:17.107605 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-5f153896-8631-406d-8b7a-bcbbdff9aab0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:59:17.108029 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-5f153896-8631-406d-8b7a-bcbbdff9aab0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:59:17.108739 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-5f153896-8631-406d-8b7a-bcbbdff9aab0 admin admin] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:59:17.109180 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-5f153896-8631-406d-8b7a-bcbbdff9aab0 admin admin] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:59:17.109559 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-5f153896-8631-406d-8b7a-bcbbdff9aab0 admin admin] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:59:17.134826 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-5f153896-8631-406d-8b7a-bcbbdff9aab0 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.091576 Sep 13 06:59:17.135321 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 37/74] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Sep 13 06:59:17 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:59:18.220071 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-48c85999-d847-4d46-b773-d0f57a07d31a admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:59:18.221491 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-48c85999-d847-4d46-b773-d0f57a07d31a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002078 Sep 13 06:59:18.222099 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 38/75] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Sep 13 06:59:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:59:18.416376 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-f88f41e3-3576-45f7-bcec-51cb4597ba00 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:59:18.419848 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-f88f41e3-3576-45f7-bcec-51cb4597ba00 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:59:18.420379 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-f88f41e3-3576-45f7-bcec-51cb4597ba00 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:59:18.420728 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-f88f41e3-3576-45f7-bcec-51cb4597ba00 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:59:18.421486 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-f88f41e3-3576-45f7-bcec-51cb4597ba00 admin admin] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:59:18.421915 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-f88f41e3-3576-45f7-bcec-51cb4597ba00 admin admin] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:59:18.422358 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-f88f41e3-3576-45f7-bcec-51cb4597ba00 admin admin] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:59:18.443760 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-f88f41e3-3576-45f7-bcec-51cb4597ba00 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.084757 Sep 13 06:59:18.444275 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 38/76] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Sep 13 06:59:18 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:00:14.152423 dv-cinder-856941-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 13 07:00:14.153466 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: Tue Sep 13 07:00:14 2022 - graceful shutdown triggered... Sep 13 07:00:14.153966 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: Gracefully killing worker 2 (pid: 105502)... Sep 13 07:00:14.154388 dv-cinder-856941-4-iscsi devstack@n-api.service[105501]: Gracefully killing worker 1 (pid: 105501)... Sep 13 07:00:14.285329 dv-cinder-856941-4-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_api:SELECT=4 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:15.154681 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: worker 1 buried after 1 seconds Sep 13 07:00:15.154681 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: worker 2 buried after 1 seconds Sep 13 07:00:15.154681 dv-cinder-856941-4-iscsi devstack@n-api.service[105500]: goodbye to uWSGI. Sep 13 07:00:15.156442 dv-cinder-856941-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 13 07:00:15.157360 dv-cinder-856941-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 13 07:00:15.161050 dv-cinder-856941-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 07:00:15.172432 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 07:00:15.174498 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 07:00:15 2022] *** Sep 13 07:00:15.174498 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 07:00:15.174498 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 07:00:15.174498 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: nodename: dv-cinder-856941-4-iscsi Sep 13 07:00:15.174498 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: machine: x86_64 Sep 13 07:00:15.174498 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: clock source: unix Sep 13 07:00:15.174498 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: pcre jit disabled Sep 13 07:00:15.174498 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: detected number of CPU cores: 4 Sep 13 07:00:15.174498 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: current working directory: / Sep 13 07:00:15.174498 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: detected binary path: /usr/bin/uwsgi-core Sep 13 07:00:15.175293 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: your processes number limit is 47680 Sep 13 07:00:15.175293 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: your memory page size is 4096 bytes Sep 13 07:00:15.175293 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: detected max file descriptor number: 2048 Sep 13 07:00:15.175293 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: lock engine: pthread robust mutexes Sep 13 07:00:15.175293 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: thunder lock: enabled Sep 13 07:00:15.175293 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 07:00:15.175293 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 07:00:15.216208 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: Python main interpreter initialized at 0x55d183b5e9c0 Sep 13 07:00:15.216208 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: python threads support enabled Sep 13 07:00:15.216208 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: your server socket listen backlog is limited to 100 connections Sep 13 07:00:15.216208 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: your mercy for graceful operations on workers is 90 seconds Sep 13 07:00:15.216679 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 07:00:15.216679 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: *** Operational MODE: preforking *** Sep 13 07:00:15.216971 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: *** uWSGI is running in multiple interpreter mode *** Sep 13 07:00:15.216971 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: spawned uWSGI master process (pid: 120683) Sep 13 07:00:15.217197 dv-cinder-856941-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 07:00:15.217817 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: spawned uWSGI worker 1 (pid: 120695, cores: 1) Sep 13 07:00:15.219338 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: spawned uWSGI worker 2 (pid: 120696, cores: 1) Sep 13 07:00:15.226424 dv-cinder-856941-4-iscsi devstack@n-api.service[120683]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 07:00:15.970268 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 07:00:16.007555 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 07:00:17.117488 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 07:00:17.117488 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: from cryptography.utils import int_from_bytes Sep 13 07:00:17.118419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 07:00:17.118419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: from cryptography.utils import int_from_bytes Sep 13 07:00:17.174729 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 07:00:17.174729 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: from cryptography.utils import int_from_bytes Sep 13 07:00:17.175538 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 07:00:17.175538 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: from cryptography.utils import int_from_bytes Sep 13 07:00:19.523411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 07:00:19.524092 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 07:00:19.524376 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 07:00:19.524591 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 07:00:19.524843 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 07:00:19.525237 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.525567 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.525911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.526248 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.526608 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.526912 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.527238 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.527558 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.527887 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.528149 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.528467 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.528974 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856941-4-iscsi {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.529303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.529613 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.529926 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.530283 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.530592 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.530917 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.531229 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.531734 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.533343 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.533343 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.533343 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.533956 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.534905 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.535483 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.536670 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.536987 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.537363 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.537660 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.538110 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856941-4-iscsi {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.538445 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.538782 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.539082 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.539520 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.539836 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.540149 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.540469 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.540795 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.541095 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.541421 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.541743 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.542068 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.542415 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.542720 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.543031 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.543346 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.543673 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.543980 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.544293 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.544591 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.544865 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.545192 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.545520 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.545842 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.546165 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.546378 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.546698 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.547029 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.547354 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.547648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.547960 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.548271 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.548579 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.548887 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.549196 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.549504 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.549837 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.550268 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.550602 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.550914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.551240 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.551659 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.551915 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.552226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.552578 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.552902 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.553213 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.553537 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.554615 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.555187 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.555733 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.556642 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.557307 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.557936 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.558387 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.558713 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.559120 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.559502 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.559896 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.560275 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.562476 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.562921 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.563333 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.563708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.564107 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.564536 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.565065 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.565463 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.566134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.566551 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.566918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.567296 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.567684 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.568138 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.568532 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.568943 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.569309 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.569695 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.570132 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.570513 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.570931 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.571309 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.571715 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.572097 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.572478 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.572862 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.573245 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.573624 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.574032 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.574435 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.574815 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.575368 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.575753 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.576271 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.576674 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.577050 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.577425 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.577803 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.578195 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.578588 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.578962 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.579356 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.579758 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.580141 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.580518 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.580900 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.581531 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.581937 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.582548 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.582973 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.583362 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.583771 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.584177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.584569 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.584942 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.585482 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.585911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.586319 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.586697 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.587114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.587487 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.587895 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.588308 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.588707 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.589098 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.589489 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.589871 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.590288 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.590676 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.591074 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.591461 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.591897 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.594437 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.595031 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.595548 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.596080 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.597157 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.598111 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.598640 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.599401 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.599805 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.600199 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.600602 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.601027 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.601431 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.601893 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.602346 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.602733 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.603760 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.604154 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.604607 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.605007 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.606193 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.606193 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.606193 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.609248 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.609248 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.609248 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.609248 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.609248 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.609248 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.609773 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.610120 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.610505 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.610899 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.611304 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.611681 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.612151 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.612639 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.613168 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.613548 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.614415 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.614415 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.614730 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.615108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.615480 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.615873 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.616249 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.616624 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.617144 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.617769 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.618208 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.618706 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.619082 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.619608 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.619994 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.620373 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.620766 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.621142 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.621517 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.621941 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.622637 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.623016 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.623406 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.623794 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.623908 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 07:00:19.624307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 07:00:19.624407 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.625868 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.626030 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 07:00:19.626230 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.626230 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.626493 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 07:00:19.626493 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 07:00:19.626772 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.626772 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.627065 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.627065 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.627377 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.627521 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.627521 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.627802 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.627985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.628183 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.628369 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.628369 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.628369 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.628976 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.629146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.629292 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.629457 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.629610 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.629761 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.630005 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856941-4-iscsi {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.630193 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.630376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.630523 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.630692 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.630848 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.630994 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.631145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.631303 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.631459 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.631603 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.631754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.631908 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.632095 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.632257 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.632547 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.632727 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.632978 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.633141 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.633298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.633451 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.633613 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.633768 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.633913 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.634065 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.634259 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.634422 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.634565 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.634714 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.634865 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.635009 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.635161 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.635304 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.635456 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.635599 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.635749 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.635900 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.636053 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.636204 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856941-4-iscsi {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.636359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.636502 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.636661 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.636805 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.636947 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.637090 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.637332 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.637671 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.637944 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.638286 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.638687 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.638913 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.639255 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.639537 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.639803 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.639966 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.640160 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.640311 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.640455 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.640606 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.640770 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.640987 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.641142 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.641294 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.641447 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.641597 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.641747 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.641905 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.642057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.642341 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.642519 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.642808 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.643004 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.643222 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.643371 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.643516 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.643725 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.643881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.644046 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.644197 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.644197 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.644482 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.644638 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.644789 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.644968 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.645121 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.645275 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.645426 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.645590 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.645748 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.645892 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.646034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.646220 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.646366 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.646517 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.646676 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.646827 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.646984 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.647139 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.647283 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.647425 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.647578 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.647749 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.647995 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.648154 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.648307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.648451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.648609 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.648780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.649015 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.649176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.649406 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.649564 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.649711 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.649861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.650005 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.650005 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.650343 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.650498 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.650498 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.650789 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.650933 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.651095 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.651239 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.651396 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.651551 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.651695 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.651847 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.651999 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.652151 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.652347 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.652496 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.652649 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.652959 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.653112 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.653366 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.653521 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.653669 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.653823 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.653968 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.654151 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.654316 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.654461 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.654612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.654758 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.654901 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.655053 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.655211 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.655375 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.655536 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.655695 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.655848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.655998 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.656156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.656308 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.656452 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.656452 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.656452 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.656869 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.657014 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.657167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.657321 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.657474 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.657617 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.657775 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.657920 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.658214 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.658365 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.658508 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.658651 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.658812 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.658965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.659248 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.659529 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.659680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.659831 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.659989 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.660142 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.660299 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.660457 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.660601 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.660746 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.660929 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.661093 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.661247 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.661405 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.661571 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.661716 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.661858 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.662001 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.662200 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.662399 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.662549 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.662694 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.662836 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.663127 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.663283 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.663521 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.663672 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.663827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.663979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.664123 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.664280 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.664433 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.664577 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.664720 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.664863 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.665013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.665166 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.665317 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.665469 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.665613 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.665776 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.665930 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.666118 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.666271 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.666271 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.666556 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.666700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.666864 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.667010 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.667167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.667318 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.667468 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.667623 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.667781 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.667935 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.668093 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.668268 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.668508 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.668667 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.668811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.668961 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.669104 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.669412 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.669651 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.669810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:00:19.669967 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.670139 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.670301 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.670459 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.670459 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.670733 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.670875 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.671029 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.671173 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.671326 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.671477 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.671627 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.671773 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.671933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.672092 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.672245 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.672437 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.672598 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.672751 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.672895 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.673204 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.673356 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.673526 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.673738 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.673895 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.674058 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.674238 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.674384 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.674528 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.674679 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.675589 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.675755 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.675912 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.675912 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.676209 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.676209 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.676504 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.676656 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.676656 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.676656 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.677079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.677231 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.677383 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.677527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.677669 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.677669 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.677960 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.678151 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.678310 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.678500 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.678762 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.678927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.679082 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.679226 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.679492 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.679660 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.679888 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.680051 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.680216 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.680368 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.680512 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.680663 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.680663 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.681306 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.681465 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.681465 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.681737 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.681879 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.682031 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.682237 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.682400 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.682590 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.682749 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.682893 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.683062 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.683399 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.683558 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.683733 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.683969 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.684119 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.684277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.684423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.684574 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.684718 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.684860 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.685003 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.685160 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.685315 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.685467 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.685620 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.685763 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.685905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.686059 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.686249 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.686396 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.686540 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.686690 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.686846 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.686990 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.687133 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.687286 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.687430 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.687572 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.687725 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.687869 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.688012 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.688155 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.688253 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.688341 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.688441 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.688524 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.688606 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.688680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.688770 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.688853 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.688937 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.689018 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.689092 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.689172 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.689247 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.689333 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.689409 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.689663 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.689761 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.689842 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.689934 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.690269 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.690540 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.691025 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.691134 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.691363 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.691674 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.691843 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.691987 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.692158 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.692318 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.692487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.692663 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.692804 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.692972 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.693112 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.693300 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.693497 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.693617 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.693746 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.693884 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.694056 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.694219 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.694395 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.694533 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.694706 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.694837 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.695016 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.695140 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.695333 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.695437 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.695648 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.695749 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.695970 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.696072 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.696284 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.696390 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.696593 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.696693 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.696909 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.697020 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.697213 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.697316 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.697515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.697610 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.697847 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.697977 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.698202 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.698299 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.698522 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.698667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.698825 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.698980 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.699137 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.699297 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.699441 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.699621 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.699734 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.699935 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.700034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.700249 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.700354 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.700563 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.700660 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.700869 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.700965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.701196 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.701321 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.701495 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.701640 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.701803 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.701957 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.702152 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.702339 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.702462 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.702643 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.702768 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.702964 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.703058 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.703276 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.703387 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.703571 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.703692 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.703924 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.704021 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.704254 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.704351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.704579 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.704676 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.704882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.704978 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.705210 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.705316 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.705520 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.705624 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.705827 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.705934 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.706235 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.706418 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.706587 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.706759 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.706920 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.707167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.707304 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.707484 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.707641 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.707827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.707974 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.708111 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.708464 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.708777 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.709100 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.709412 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.709718 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.710011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.710346 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.710683 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.711017 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.711330 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.711657 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.712021 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.712312 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.712473 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.712579 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.712760 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.712931 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.713237 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.713342 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.713538 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.713635 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.713848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.713954 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.714283 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.714400 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.714560 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.714656 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.714863 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.715027 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.715186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.715346 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.715500 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.715657 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.715815 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.715963 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.716113 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.716281 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.716383 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.716698 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.716794 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.717015 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.717111 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.717321 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.717416 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.717629 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.717726 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.717943 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.718054 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.718308 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.718470 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.718613 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.718761 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.718936 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.719094 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.719245 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.719398 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.719575 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.719769 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.720042 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.720207 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.720350 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.720491 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.720641 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.720782 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.720925 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.721077 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.721221 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.721370 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.721520 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.721662 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.721862 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.722005 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.722245 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.722537 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.722694 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.722882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.723039 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.723183 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.723325 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.723473 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.723796 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.723944 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.724145 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.724339 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.724557 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.724864 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.725033 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.725188 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.725343 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.725493 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.725639 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.725801 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.725956 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.726164 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.726322 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.726471 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.726631 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.726779 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.726926 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.727095 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.727247 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.727403 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.727561 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.727716 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.727864 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.728024 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.728172 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.728320 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.728467 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.728632 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.728780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.728941 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.729097 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.729259 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.729409 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.729556 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.729716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.729875 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.730048 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.730291 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.730447 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.730620 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.730781 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.730929 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.731086 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.731241 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.731397 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.731554 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.731554 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.731869 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.732027 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.732182 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.732330 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.732485 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.732662 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.732818 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.732994 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.733152 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.733300 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.733467 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.733624 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.733771 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.733953 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.734121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.734121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.734427 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.734605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.734840 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.735008 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.735163 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.735319 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.735482 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.735632 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.735816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.735974 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.736145 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.736295 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.736456 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.736614 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.736771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.736939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.737099 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.737255 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.737461 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.737613 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.737771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.737934 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.738221 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.738390 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.738390 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.738671 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.738828 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.738998 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.739157 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.739313 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.739461 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.739609 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.739770 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.739920 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.740079 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.740228 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.740475 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.740632 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.740791 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.740948 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.741108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.741264 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.741412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.741560 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.741560 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.741865 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.742015 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.742189 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.742350 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.742508 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.742741 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.742891 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.743040 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.743207 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.743356 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.743518 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.743666 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.743813 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.743966 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.744124 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.744280 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.744443 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.744592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.744746 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.744978 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.745134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.745294 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.745466 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.745623 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.745773 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.745920 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.746068 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.746255 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.746415 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.746571 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.746727 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.746875 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.747037 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.747218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.747377 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.747525 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.747679 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.747827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.747973 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.748135 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.748292 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.748440 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.748587 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.748733 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.748879 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.749034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.749205 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.749362 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.749518 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.749666 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.749812 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.749973 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.750161 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.750327 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.750502 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.750732 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.750904 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.751060 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.751216 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.751374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.751522 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.751678 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.751835 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.751991 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.752140 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.752294 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.752443 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.752590 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.752746 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.752901 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.753126 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.753364 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.753546 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.753696 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.753860 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.754008 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.754191 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.754343 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.754497 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.754660 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.754810 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.754982 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.755210 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.755210 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.755526 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.755691 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.755840 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.755840 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.756144 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.756293 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.756440 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.756602 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.756753 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.756901 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.757067 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.757217 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.757380 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.757552 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.757702 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.757851 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.757999 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.758191 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.758350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.758500 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.758662 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.758812 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.758967 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.759124 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.759280 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.759439 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.759595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.759751 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.759910 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.760057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.760204 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.760360 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.760508 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.760664 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.760910 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.761083 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.761247 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.761405 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.761577 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.761726 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.761884 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.762037 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.762226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.762353 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.762447 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.762570 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.762655 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.762750 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.762835 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.762919 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.763002 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.763095 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.763229 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.763327 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.763414 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.763498 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.763582 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.763731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.763818 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.763910 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.764010 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.764103 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.764197 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.764299 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.764372 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.764455 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.764551 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.764645 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.764738 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.764823 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.764907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.764995 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.765078 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.765161 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.765249 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.765324 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.765428 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.765621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.765793 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.765950 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.766266 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.766435 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.766593 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.766741 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.766889 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.767046 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.767197 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.767351 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.767511 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.767668 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.767825 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.767989 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.768147 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.768305 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.768452 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.768656 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.768820 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.768982 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.769200 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.769415 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.769578 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.769740 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.769889 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.770048 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.770238 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.770390 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.770537 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.770684 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.770842 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.771087 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.771243 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.771392 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.771549 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.771709 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.771871 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.772028 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.772179 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.772326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.772473 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.772628 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.772866 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.773030 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.773195 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.773342 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.773491 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.773645 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.773817 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.773966 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.774130 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.774284 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.774473 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.774641 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.774790 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.774945 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.775101 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.775259 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.775438 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.775598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.775754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.775923 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.776072 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.776219 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.776366 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.776528 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.776686 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.776834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.776980 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.777127 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.777282 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.777443 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.777599 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.777758 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.777906 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.778054 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.778252 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.778411 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.778567 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.778726 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.778873 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.779029 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.779186 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.779342 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.779490 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.779637 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.779805 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.779954 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.780116 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.780272 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.780429 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.780584 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.780732 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.780890 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.781066 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.781066 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.781435 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.781622 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.781775 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.781775 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.782097 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.782263 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.782413 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.782569 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.782726 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.782905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.783282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.783430 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.783586 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.783737 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.783737 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.784052 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.784247 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.784413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.784561 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.784717 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.784878 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.785029 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.785176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.785176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.785176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.785605 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.785753 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.785920 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.786090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.786256 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.786405 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.786565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.786565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.786854 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.787018 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.787177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.787332 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.787495 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.787651 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.787799 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.787964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.788114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.788261 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.788426 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.788589 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.788750 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.788905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.789068 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.789232 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.789380 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.789535 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.789692 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.789847 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.790014 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.790202 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.790353 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.790502 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.790649 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.790649 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.790944 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.791102 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.791278 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.791446 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.791609 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.791764 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.791995 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.792149 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.792304 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.792460 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.792609 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.792764 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.792922 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.793071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.793311 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.793472 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.793621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.793784 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.793942 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.794122 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.794277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.794429 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.794589 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.795116 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.795299 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.795451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.795602 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.795760 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.795907 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.796082 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.796240 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.796388 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.796549 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.796705 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.796853 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.797013 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.797162 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.797320 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.797469 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.797618 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.797765 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.797921 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.798139 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.798307 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.798476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.798644 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.798818 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.798968 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.799116 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.799263 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.799427 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.799584 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.799783 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.800003 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.800163 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.800319 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.800592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.800772 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.800936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.801086 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.801234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.801388 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.801551 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.801707 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.801707 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.802013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.802192 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.802354 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.802502 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.802671 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.802821 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.802968 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.803125 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.803292 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.803512 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.803676 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.803834 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.803990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.804146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.804294 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.804448 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.804609 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.804772 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.804930 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.805088 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.805245 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.805406 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.805555 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.805710 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.805859 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.806381 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.806546 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.806709 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.806858 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.807026 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.807184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.807339 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.807493 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.807658 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.807815 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.807963 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.808118 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.808274 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.808422 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.808583 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.808741 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.808901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.809070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.809219 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.809375 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.809524 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.809672 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.809836 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.809991 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.810200 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.810363 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.810512 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.810677 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.810826 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.810973 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.811130 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.811130 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.811430 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.811586 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.811734 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.811882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.812030 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.812193 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.812352 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.812500 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.812647 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.812801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.812958 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.813126 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.813276 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.813431 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.813661 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.813815 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.813973 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.814138 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.814291 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.814452 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.814600 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.814747 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.814902 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.815069 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.815218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.815218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.815530 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.815530 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.815965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.816117 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.816264 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.816420 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.816569 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.816731 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.816888 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.817044 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.817210 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.817359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.817514 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.817679 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.817679 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.817968 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.818153 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.818308 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.818456 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.818614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.818778 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.818929 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.819097 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.819253 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.819415 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.819574 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.819722 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.819879 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.820035 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.820035 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.820334 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.820482 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.820630 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.820778 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.820935 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.821092 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.821252 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.821409 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.821557 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.821706 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.821854 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.822098 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.822265 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.822418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.822566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.822715 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.822884 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.823050 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.823200 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.823356 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.823504 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.823669 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.823828 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.823985 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.824143 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.824290 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.824436 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.824583 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.824739 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.824967 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.825140 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.825299 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.825448 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.825603 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.825764 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.825915 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.826062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.826251 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.826407 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.826407 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.826701 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.826874 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.827024 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.827171 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.827325 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 07:00:19.827487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.827487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.827487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.827487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.827487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.827487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.827487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.828465 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.828465 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.828465 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.828896 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.829043 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.829256 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.829565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.829873 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.830206 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.830532 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.830849 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.831348 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.831987 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.832302 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.832842 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.833196 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.833513 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.833844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.834188 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.834510 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.834819 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.835145 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.835455 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.835765 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.836084 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.836399 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.836705 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.837009 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.837319 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.837630 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.837936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.838269 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.838573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.838896 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.839201 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.839505 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.839809 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.840118 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.840422 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.840727 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.841035 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.841338 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.841648 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.841987 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.842411 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.842689 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.843001 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.843357 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.843666 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.843970 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.844292 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.844595 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.844899 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.845214 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.845522 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.845842 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.846174 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.846488 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.846960 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.847371 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.847915 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.848242 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.848561 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.848895 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.849227 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.849537 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.849840 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.850166 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.850491 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.850804 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.851113 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.851420 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.851724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.852071 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.852366 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.852671 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.852976 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.853249 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.853553 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.853858 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.854185 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.854493 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.854798 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.855111 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.855455 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.855772 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.856090 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.856406 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.856721 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.857032 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.857343 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.857653 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.857963 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.858300 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.858631 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.858944 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.859245 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.859665 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.859979 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.860298 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.860620 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.860927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.861245 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.861569 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.861879 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.862226 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.863037 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.863386 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.863729 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.864062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.864390 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.864699 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.865005 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.865313 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.865621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.865938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.866274 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.866580 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.866881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.867188 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.867488 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.867791 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.868092 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.868393 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.868697 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.868999 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.869298 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.869597 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.869897 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.870220 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.870525 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.870834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.871137 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.871440 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.871741 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.872040 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.872341 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.872668 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.873020 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.873320 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.873644 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.873957 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.874315 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.874624 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.874946 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.875271 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.875585 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.875896 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.876226 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.876533 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.876843 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.877155 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.877463 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.877772 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.878220 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.878990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.879326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.879636 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.879967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.880289 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.880609 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.880932 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.881245 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.881573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.881883 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.882218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.882528 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.882837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.883145 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.883460 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.883768 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.884075 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.884386 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.884698 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.885024 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.885347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.885654 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.885976 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.886324 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.886669 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.886876 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO dbcounter [None req-18486237-b264-4b5c-aa67-01f25d332d9c None None] Registered counter for database nova_api Sep 13 07:00:19.887034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.887313 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.887638 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.887950 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.888261 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.888564 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:00:19.888806 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 07:00:19.907542 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_db.sqlalchemy.engines [None req-18486237-b264-4b5c-aa67-01f25d332d9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:00:19.914934 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writer thread running {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:00:19.952627 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO dbcounter [None req-1f9c20fe-dfb4-4c48-8327-1a7654eee38c None None] Registered counter for database nova_api Sep 13 07:00:19.971866 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.context [None req-18486237-b264-4b5c-aa67-01f25d332d9c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb5fd9cb-18fe-4379-ac3d-53b158992ccd(cell1) {{(pid=120695) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 07:00:19.973779 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_db.sqlalchemy.engines [None req-1f9c20fe-dfb4-4c48-8327-1a7654eee38c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120696) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:00:19.976119 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-18486237-b264-4b5c-aa67-01f25d332d9c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:00:19.976566 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-18486237-b264-4b5c-aa67-01f25d332d9c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:00:19.978150 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-18486237-b264-4b5c-aa67-01f25d332d9c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:00:19.978891 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-18486237-b264-4b5c-aa67-01f25d332d9c None None] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:00:19.979329 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-18486237-b264-4b5c-aa67-01f25d332d9c None None] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:00:19.981137 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writer thread running {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:00:19.981314 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-18486237-b264-4b5c-aa67-01f25d332d9c None None] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:00:19.983369 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO dbcounter [None req-18486237-b264-4b5c-aa67-01f25d332d9c None None] Registered counter for database nova_cell0 Sep 13 07:00:19.987486 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO dbcounter [None req-18486237-b264-4b5c-aa67-01f25d332d9c None None] Registered counter for database nova_cell1 Sep 13 07:00:19.994864 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_db.sqlalchemy.engines [None req-18486237-b264-4b5c-aa67-01f25d332d9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:00:19.997276 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_db.sqlalchemy.engines [None req-18486237-b264-4b5c-aa67-01f25d332d9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:00:20.005408 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writer thread running {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:00:20.005779 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writer thread running {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:00:20.040370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.context [None req-1f9c20fe-dfb4-4c48-8327-1a7654eee38c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb5fd9cb-18fe-4379-ac3d-53b158992ccd(cell1) {{(pid=120696) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 07:00:20.044835 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f9c20fe-dfb4-4c48-8327-1a7654eee38c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:00:20.045370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f9c20fe-dfb4-4c48-8327-1a7654eee38c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:00:20.047099 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f9c20fe-dfb4-4c48-8327-1a7654eee38c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:00:20.047841 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f9c20fe-dfb4-4c48-8327-1a7654eee38c None None] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:00:20.048288 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f9c20fe-dfb4-4c48-8327-1a7654eee38c None None] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:00:20.050341 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f9c20fe-dfb4-4c48-8327-1a7654eee38c None None] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:00:20.052418 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO dbcounter [None req-1f9c20fe-dfb4-4c48-8327-1a7654eee38c None None] Registered counter for database nova_cell0 Sep 13 07:00:20.057030 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO dbcounter [None req-1f9c20fe-dfb4-4c48-8327-1a7654eee38c None None] Registered counter for database nova_cell1 Sep 13 07:00:20.064688 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_db.sqlalchemy.engines [None req-1f9c20fe-dfb4-4c48-8327-1a7654eee38c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120696) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:00:20.066529 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_db.sqlalchemy.engines [None req-1f9c20fe-dfb4-4c48-8327-1a7654eee38c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120696) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:00:20.073402 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writer thread running {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:00:20.075031 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writer thread running {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:00:20.161846 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO dbcounter [None req-18486237-b264-4b5c-aa67-01f25d332d9c None None] Registered counter for database nova_cell0 Sep 13 07:00:20.169718 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_db.sqlalchemy.engines [None req-18486237-b264-4b5c-aa67-01f25d332d9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:00:20.175631 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writer thread running {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:00:20.222874 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO dbcounter [None req-1f9c20fe-dfb4-4c48-8327-1a7654eee38c None None] Registered counter for database nova_cell0 Sep 13 07:00:20.231831 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_db.sqlalchemy.engines [None req-1f9c20fe-dfb4-4c48-8327-1a7654eee38c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120696) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:00:20.237166 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writer thread running {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:00:20.495181 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: WARNING keystonemiddleware.auth_token [None req-18486237-b264-4b5c-aa67-01f25d332d9c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 07:00:20.502893 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: WARNING keystonemiddleware.auth_token [None req-18486237-b264-4b5c-aa67-01f25d332d9c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 07:00:20.576468 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: WARNING keystonemiddleware.auth_token [None req-1f9c20fe-dfb4-4c48-8327-1a7654eee38c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 07:00:20.584549 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: WARNING keystonemiddleware.auth_token [None req-1f9c20fe-dfb4-4c48-8327-1a7654eee38c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 07:00:20.851697 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: WARNING keystonemiddleware.auth_token [None req-18486237-b264-4b5c-aa67-01f25d332d9c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 07:00:20.858035 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: WARNING keystonemiddleware.auth_token [None req-18486237-b264-4b5c-aa67-01f25d332d9c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 07:00:20.863591 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d183b5e9c0 pid: 120695 (default app) Sep 13 07:00:20.940858 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: WARNING keystonemiddleware.auth_token [None req-1f9c20fe-dfb4-4c48-8327-1a7654eee38c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 07:00:20.947006 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: WARNING keystonemiddleware.auth_token [None req-1f9c20fe-dfb4-4c48-8327-1a7654eee38c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 07:00:20.952556 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d183b5e9c0 pid: 120696 (default app) Sep 13 07:00:57.303255 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:57.305024 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:57.306568 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:57.307509 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:59.214384 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b0533883-8dda-4873-8f2a-317ab42dc6b7 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] Action: 'create', calling method: .version_select at 0x7f4c1a633430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-5981497", "metadata": {"Type": "work"}}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:00:59.227226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b0533883-8dda-4873-8f2a-317ab42dc6b7 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] Request method failure captured: Sep 13 07:00:59.227226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 07:00:59.227226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:00:59.227226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:00:59.227226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:00:59.227226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 119 Sep 13 07:00:59.227226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:00:59.227226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:00:59.227226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:00:59.227226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:00:59.227226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICqp6MASzkU2ao242pACBSnF34LuN70hdWDNaP8LU5YrYOR5iAnqjcLQpAUXaToL2jJykykiSDnG79ywFiTDbdVF2MGEU3FSkbub5-Gj-5pCDnwoHF8ILAcB8eq6ilvZQd7mi7bpwTUUr1kxrgDP-Pq2LuZUxX9_aS1JYUfXQdHn-NE Sep 13 07:00:59.227226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:00:59.227226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:00:59.227226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:00:59.227226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:00:59.227226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:00:59.227226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:00:59.227226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: b5ea0c5e37d54c28b948355d9c4be3f2 Sep 13 07:00:59.227226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-VolumesNegativeTest-617713170 Sep 13 07:00:59.227226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:00:59.227226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:00:59.228765 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b5ea0c5e37d54c28b948355d9c4be3f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5ea0c5e37d54c28b948355d9c4be3f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5ea0c5e37d54c28b948355d9c4be3f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b5ea0c5e37d54c28b948355d9c4be3f2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:00:59.228765 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-VolumesNegativeTest-617713170 Sep 13 07:00:59.228765 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: b5ea0c5e37d54c28b948355d9c4be3f2 Sep 13 07:00:59.228765 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-VolumesNegativeTest-617713170 Sep 13 07:00:59.228765 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-VolumesNegativeTest-617713170-project Sep 13 07:00:59.228765 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:00:59.228765 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:00:59.228765 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: 84f133a848ed4f64a2c1bd0fc53c0424 Sep 13 07:00:59.228765 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-VolumesNegativeTest-617713170-project Sep 13 07:00:59.228765 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Sep 13 07:00:59.228765 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-5981497", "metadata": {"Type": "work"}}} Sep 13 07:00:59.228765 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: Sep 13 07:00:59.228765 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-5981497', 'metadata': {'Type': 'work'}}}} Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise error Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi '#$%' Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:00:59.229708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:00:59.231090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 07:00:59.231090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 07:00:59.231090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:00:59.231090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:00:59.231090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 07:00:59.231090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 07:00:59.231090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 07:00:59.231090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 07:00:59.231090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 07:00:59.231090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 07:00:59.231090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 07:00:59.231090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:00:59.231090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:00:59.231090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:00:59.231090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:00:59.231090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:00:59.231090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:00:59.231090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 07:00:59.231090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 07:00:59.232384 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 07:00:59.232384 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:00:59.236549 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b0533883-8dda-4873-8f2a-317ab42dc6b7 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:00:59.239027 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b0533883-8dda-4873-8f2a-317ab42dc6b7 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.947793 Sep 13 07:00:59.242609 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1156 bytes} [Tue Sep 13 07:00:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1951 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 07:00:59.253384 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:59.254474 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:59.254988 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:59.255717 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:59.942790 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-11d57a5e-8884-485d-a9af-1ddd6a443225 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] Action: 'create', calling method: .version_select at 0x7f4c1a6e8940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-504292239", "metadata": {"Type": "work"}}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:00:59.954184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-11d57a5e-8884-485d-a9af-1ddd6a443225 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] Request method failure captured: Sep 13 07:00:59.954184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 07:00:59.954184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:00:59.954184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:00:59.954184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:00:59.954184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 119 Sep 13 07:00:59.954184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:00:59.954184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:00:59.954184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:00:59.954184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:00:59.954184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICqp6MASzkU2ao242pACBSnF34LuN70hdWDNaP8LU5YrYOR5iAnqjcLQpAUXaToL2jJykykiSDnG79ywFiTDbdVF2MGEU3FSkbub5-Gj-5pCDnwoHF8ILAcB8eq6ilvZQd7mi7bpwTUUr1kxrgDP-Pq2LuZUxX9_aS1JYUfXQdHn-NE Sep 13 07:00:59.954184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:00:59.954184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:00:59.954184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:00:59.954184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:00:59.954184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:00:59.954184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:00:59.954184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: b5ea0c5e37d54c28b948355d9c4be3f2 Sep 13 07:00:59.954184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-VolumesNegativeTest-617713170 Sep 13 07:00:59.954184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:00:59.954184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:00:59.956012 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b5ea0c5e37d54c28b948355d9c4be3f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5ea0c5e37d54c28b948355d9c4be3f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5ea0c5e37d54c28b948355d9c4be3f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b5ea0c5e37d54c28b948355d9c4be3f2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:00:59.956012 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-VolumesNegativeTest-617713170 Sep 13 07:00:59.956012 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: b5ea0c5e37d54c28b948355d9c4be3f2 Sep 13 07:00:59.956012 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-VolumesNegativeTest-617713170 Sep 13 07:00:59.956012 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-VolumesNegativeTest-617713170-project Sep 13 07:00:59.956012 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:00:59.956012 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:00:59.956012 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 84f133a848ed4f64a2c1bd0fc53c0424 Sep 13 07:00:59.956012 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-VolumesNegativeTest-617713170-project Sep 13 07:00:59.956012 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Sep 13 07:00:59.956012 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-504292239", "metadata": {"Type": "work"}}} Sep 13 07:00:59.956012 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: Sep 13 07:00:59.956012 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-504292239', 'metadata': {'Type': 'work'}}}} Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise error Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi '0' Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:00:59.957011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:00:59.958834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 07:00:59.958834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 07:00:59.958834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:00:59.958834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:00:59.958834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 07:00:59.958834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 07:00:59.958834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 07:00:59.958834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 07:00:59.958834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 07:00:59.958834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 07:00:59.958834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 07:00:59.958834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:00:59.958834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:00:59.958834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:00:59.958834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:00:59.958834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:00:59.958834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:00:59.958834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 07:00:59.958834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 07:00:59.960207 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 07:00:59.960207 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:00:59.960207 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-11d57a5e-8884-485d-a9af-1ddd6a443225 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:00:59.960207 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-11d57a5e-8884-485d-a9af-1ddd6a443225 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.711250 Sep 13 07:00:59.963061 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 1/2] 10.222.0.25 () {60 vars in 1156 bytes} [Tue Sep 13 07:00:59 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 717 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 07:00:59.968783 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b92b52c7-104c-4af4-a62c-b81ea61016b8 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] Action: 'create', calling method: .version_select at 0x7f4c1a633d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-119350003", "metadata": {"Type": "work"}}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:00:59.973919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b92b52c7-104c-4af4-a62c-b81ea61016b8 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] Request method failure captured: Sep 13 07:00:59.973919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 07:00:59.973919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:00:59.973919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:00:59.973919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:00:59.973919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 118 Sep 13 07:00:59.973919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:00:59.973919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:00:59.973919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:00:59.973919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:00:59.973919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICqp6MASzkU2ao242pACBSnF34LuN70hdWDNaP8LU5YrYOR5iAnqjcLQpAUXaToL2jJykykiSDnG79ywFiTDbdVF2MGEU3FSkbub5-Gj-5pCDnwoHF8ILAcB8eq6ilvZQd7mi7bpwTUUr1kxrgDP-Pq2LuZUxX9_aS1JYUfXQdHn-NE Sep 13 07:00:59.973919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:00:59.973919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:00:59.973919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:00:59.973919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:00:59.973919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:00:59.973919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:00:59.973919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: b5ea0c5e37d54c28b948355d9c4be3f2 Sep 13 07:00:59.973919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-VolumesNegativeTest-617713170 Sep 13 07:00:59.973919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:00:59.973919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:00:59.975570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b5ea0c5e37d54c28b948355d9c4be3f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5ea0c5e37d54c28b948355d9c4be3f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5ea0c5e37d54c28b948355d9c4be3f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b5ea0c5e37d54c28b948355d9c4be3f2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:00:59.975570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-VolumesNegativeTest-617713170 Sep 13 07:00:59.975570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: b5ea0c5e37d54c28b948355d9c4be3f2 Sep 13 07:00:59.975570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-VolumesNegativeTest-617713170 Sep 13 07:00:59.975570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-VolumesNegativeTest-617713170-project Sep 13 07:00:59.975570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:00:59.975570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:00:59.975570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: 84f133a848ed4f64a2c1bd0fc53c0424 Sep 13 07:00:59.975570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-VolumesNegativeTest-617713170-project Sep 13 07:00:59.975570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Sep 13 07:00:59.975570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-119350003", "metadata": {"Type": "work"}}} Sep 13 07:00:59.975570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: Sep 13 07:00:59.975570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-119350003', 'metadata': {'Type': 'work'}}}} Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise error Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi '' Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:00:59.976402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:00:59.977951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 07:00:59.977951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 07:00:59.977951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:00:59.977951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:00:59.977951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 07:00:59.977951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 07:00:59.977951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 07:00:59.977951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 07:00:59.977951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 07:00:59.977951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 07:00:59.977951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 07:00:59.977951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:00:59.977951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:00:59.977951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:00:59.977951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:00:59.977951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:00:59.977951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:00:59.977951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 07:00:59.977951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 07:00:59.979425 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 07:00:59.979425 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:00:59.984819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b92b52c7-104c-4af4-a62c-b81ea61016b8 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:00:59.990538 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b92b52c7-104c-4af4-a62c-b81ea61016b8 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.025635 Sep 13 07:00:59.995313 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 2/3] 10.222.0.25 () {60 vars in 1156 bytes} [Tue Sep 13 07:00:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 07:01:00.008426 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ff80d2a4-82ad-4ddb-b28f-928a51e31ee0 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] Calling method '.version_select at 0x7f4c1a68bb80>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:00.468086 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-41cb8139-30ec-4465-be36-ebaabf9483eb tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] Calling method '.version_select at 0x7f4c1a4e5160>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-ff80d2a4-82ad-4ddb-b28f-928a51e31ee0 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] HTTP exception thrown: Volume tempest-invalid-65491356 could not be found. Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ff80d2a4-82ad-4ddb-b28f-928a51e31ee0 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] Request method failure captured: Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-65491356 HTTP/1.1 Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICqp6MASzkU2ao242pACBSnF34LuN70hdWDNaP8LU5YrYOR5iAnqjcLQpAUXaToL2jJykykiSDnG79ywFiTDbdVF2MGEU3FSkbub5-Gj-5pCDnwoHF8ILAcB8eq6ilvZQd7mi7bpwTUUr1kxrgDP-Pq2LuZUxX9_aS1JYUfXQdHn-NE Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: b5ea0c5e37d54c28b948355d9c4be3f2 Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-VolumesNegativeTest-617713170 Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:01:00.668700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:01:00.674307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b5ea0c5e37d54c28b948355d9c4be3f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5ea0c5e37d54c28b948355d9c4be3f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5ea0c5e37d54c28b948355d9c4be3f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b5ea0c5e37d54c28b948355d9c4be3f2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:01:00.674307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-VolumesNegativeTest-617713170 Sep 13 07:01:00.674307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: b5ea0c5e37d54c28b948355d9c4be3f2 Sep 13 07:01:00.674307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-VolumesNegativeTest-617713170 Sep 13 07:01:00.674307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-VolumesNegativeTest-617713170-project Sep 13 07:01:00.674307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:01:00.674307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:01:00.674307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 84f133a848ed4f64a2c1bd0fc53c0424 Sep 13 07:01:00.674307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-VolumesNegativeTest-617713170-project Sep 13 07:01:00.674307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: Sep 13 07:01:00.674307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Volume tempest-invalid-65491356 could not be found. Sep 13 07:01:00.674307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': 'tempest-invalid-65491356'} Sep 13 07:01:00.674307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:01:00.679913 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:01:00.679913 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:01:00.679913 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:01:00.679913 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 07:01:00.679913 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 07:01:00.679913 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 07:01:00.679913 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 07:01:00.679913 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 07:01:00.679913 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 07:01:00.679913 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 07:01:00.679913 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 07:01:00.679913 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:01:00.679913 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:01:00.679913 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:01:00.679913 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:01:00.679913 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-65491356 could not be found. (HTTP 404) (Request-ID: req-ee8af676-c91d-4b8c-9b2c-0fd8bbe2a26b) Sep 13 07:01:00.679913 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:01:00.679913 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:01:00.679913 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:01:00.683376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:01:00.683376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 07:01:00.683376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 07:01:00.683376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 07:01:00.683376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 07:01:00.683376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 07:01:00.683376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 07:01:00.683376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 07:01:00.683376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 07:01:00.683376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:01:00.683376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:01:00.683376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 07:01:00.683376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 07:01:00.683376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 07:01:00.683376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 07:01:00.683376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 07:01:00.683376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 07:01:00.683376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 07:01:00.683376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 07:01:00.687070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:01:00.687070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:01:00.687070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:01:00.687070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:01:00.687070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-65491356 could not be found. Sep 13 07:01:00.687070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:01:00.687070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:01:00.687070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:01:00.687070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:01:00.687070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:01:00.687070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:01:00.687070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:01:00.687070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:01:00.687070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 07:01:00.687070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 07:01:00.687070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:01:00.687070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:01:00.687070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 07:01:00.687070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:01:00.687070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-65491356 could not be found. Sep 13 07:01:00.690810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:01:00.690810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:01:00.690810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:01:00.690810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:01:00.690810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:01:00.690810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:01:00.690810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:01:00.690810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:01:00.690810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-65491356 could not be found. Sep 13 07:01:00.690810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:01:00.690810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ff80d2a4-82ad-4ddb-b28f-928a51e31ee0 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] Returning 404 to user: Volume tempest-invalid-65491356 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:01:00.690810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ff80d2a4-82ad-4ddb-b28f-928a51e31ee0 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-65491356" status: 404 len: 97 microversion: 2.1 time: 0.637991 Sep 13 07:01:00.690810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1212 bytes} [Tue Sep 13 07:00:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-65491356 => generated 97 bytes in 644 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 07:01:00.691561 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a4f035e8-c18a-4859-9a49-bca5702f9419 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007088 Sep 13 07:01:00.691561 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 3/5] 10.222.0.25 () {58 vars in 1140 bytes} [Tue Sep 13 07:01:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 07:01:00.691561 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8a7d3fda-8b47-42cd-ba60-972c46ad8e6a tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006027 Sep 13 07:01:00.691561 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 4/6] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Sep 13 07:01:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 07:01:00.691561 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dbc5def6-c178-4eb7-b54b-4bc74cfd17ea tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] Calling method '.version_select at 0x7f4c1a470d30>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:00.837182 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-dbc5def6-c178-4eb7-b54b-4bc74cfd17ea tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] HTTP exception thrown: Volume d97e3833-397c-4867-afca-1f16746418fa could not be found. Sep 13 07:01:00.839442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dbc5def6-c178-4eb7-b54b-4bc74cfd17ea tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] Request method failure captured: Sep 13 07:01:00.839442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/os-volumes/d97e3833-397c-4867-afca-1f16746418fa HTTP/1.1 Sep 13 07:01:00.839442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:01:00.839442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:01:00.839442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:01:00.839442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:01:00.839442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:01:00.839442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:01:00.839442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:01:00.839442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:01:00.839442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICqp6MASzkU2ao242pACBSnF34LuN70hdWDNaP8LU5YrYOR5iAnqjcLQpAUXaToL2jJykykiSDnG79ywFiTDbdVF2MGEU3FSkbub5-Gj-5pCDnwoHF8ILAcB8eq6ilvZQd7mi7bpwTUUr1kxrgDP-Pq2LuZUxX9_aS1JYUfXQdHn-NE Sep 13 07:01:00.839442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:01:00.839442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:01:00.839442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:01:00.839442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:01:00.839442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:01:00.839442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:01:00.839442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: b5ea0c5e37d54c28b948355d9c4be3f2 Sep 13 07:01:00.839442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-VolumesNegativeTest-617713170 Sep 13 07:01:00.839442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:01:00.839442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:01:00.840634 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b5ea0c5e37d54c28b948355d9c4be3f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5ea0c5e37d54c28b948355d9c4be3f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5ea0c5e37d54c28b948355d9c4be3f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b5ea0c5e37d54c28b948355d9c4be3f2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:01:00.840634 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-VolumesNegativeTest-617713170 Sep 13 07:01:00.840634 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: b5ea0c5e37d54c28b948355d9c4be3f2 Sep 13 07:01:00.840634 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-VolumesNegativeTest-617713170 Sep 13 07:01:00.840634 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-VolumesNegativeTest-617713170-project Sep 13 07:01:00.840634 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:01:00.840634 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:01:00.840634 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 84f133a848ed4f64a2c1bd0fc53c0424 Sep 13 07:01:00.840634 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-VolumesNegativeTest-617713170-project Sep 13 07:01:00.840634 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: Sep 13 07:01:00.840634 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Volume d97e3833-397c-4867-afca-1f16746418fa could not be found. Sep 13 07:01:00.840634 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': 'd97e3833-397c-4867-afca-1f16746418fa'} Sep 13 07:01:00.840634 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:01:00.841351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:01:00.841351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:01:00.841351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:01:00.841351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 07:01:00.841351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 07:01:00.841351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 07:01:00.841351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 07:01:00.841351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 07:01:00.841351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 07:01:00.841351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 07:01:00.841351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 07:01:00.841351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:01:00.841351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:01:00.841351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:01:00.841351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:01:00.841351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d97e3833-397c-4867-afca-1f16746418fa could not be found. (HTTP 404) (Request-ID: req-05d157c5-9738-468f-8012-6591cfe2edab) Sep 13 07:01:00.841351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:01:00.841351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:01:00.841351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:01:00.842297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:01:00.842297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 07:01:00.842297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 07:01:00.842297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 07:01:00.842297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 07:01:00.842297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 07:01:00.842297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 07:01:00.842297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 07:01:00.842297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 07:01:00.842297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:01:00.842297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:01:00.842297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 07:01:00.842297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 07:01:00.842297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 07:01:00.842297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 07:01:00.842297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 07:01:00.842297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 07:01:00.842297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 07:01:00.842297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 07:01:00.843176 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:01:00.843176 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:01:00.843176 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:01:00.843176 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:01:00.843176 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d97e3833-397c-4867-afca-1f16746418fa could not be found. Sep 13 07:01:00.843176 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:01:00.843176 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:01:00.843176 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:01:00.843176 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:01:00.843176 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:01:00.843176 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:01:00.843176 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:01:00.843176 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:01:00.843176 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 07:01:00.843176 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 07:01:00.843176 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:01:00.843176 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:01:00.843176 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 07:01:00.843176 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:01:00.844028 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d97e3833-397c-4867-afca-1f16746418fa could not be found. Sep 13 07:01:00.844028 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:01:00.844028 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:01:00.844028 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:01:00.844028 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:01:00.844028 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:01:00.844028 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:01:00.844028 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:01:00.844028 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:01:00.844028 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d97e3833-397c-4867-afca-1f16746418fa could not be found. Sep 13 07:01:00.844028 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:01:00.851672 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dbc5def6-c178-4eb7-b54b-4bc74cfd17ea tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] Returning 404 to user: Volume d97e3833-397c-4867-afca-1f16746418fa could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:01:00.858163 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dbc5def6-c178-4eb7-b54b-4bc74cfd17ea tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/d97e3833-397c-4867-afca-1f16746418fa" status: 404 len: 109 microversion: 2.1 time: 0.182776 Sep 13 07:01:00.860821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 5/7] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Sep 13 07:01:00 2022] DELETE /compute/v2.1/os-volumes/d97e3833-397c-4867-afca-1f16746418fa => generated 109 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:01:00.874604 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6ee07616-3318-4786-b627-d0120acd44d2 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] Calling method '.version_select at 0x7f4c1a417af0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:01.035276 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-41cb8139-30ec-4465-be36-ebaabf9483eb tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/daf4dcd9-06c5-4095-aac3-246c42d021d6" status: 200 len: 350 microversion: 2.1 time: 0.579015 Sep 13 07:01:01.044392 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 3/8] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Sep 13 07:01:00 2022] GET /compute/v2.1/os-volumes/daf4dcd9-06c5-4095-aac3-246c42d021d6 => generated 350 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:01:01.093825 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-6ee07616-3318-4786-b627-d0120acd44d2 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] HTTP exception thrown: Volume 7e9b6f4d-69ac-4702-bff3-c0b10dce5e70 could not be found. Sep 13 07:01:01.095800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6ee07616-3318-4786-b627-d0120acd44d2 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] Request method failure captured: Sep 13 07:01:01.095800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/os-volumes/7e9b6f4d-69ac-4702-bff3-c0b10dce5e70 HTTP/1.1 Sep 13 07:01:01.095800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:01:01.095800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:01:01.095800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:01:01.095800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:01:01.095800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:01:01.095800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:01:01.095800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:01:01.095800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:01:01.095800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICqp6MASzkU2ao242pACBSnF34LuN70hdWDNaP8LU5YrYOR5iAnqjcLQpAUXaToL2jJykykiSDnG79ywFiTDbdVF2MGEU3FSkbub5-Gj-5pCDnwoHF8ILAcB8eq6ilvZQd7mi7bpwTUUr1kxrgDP-Pq2LuZUxX9_aS1JYUfXQdHn-NE Sep 13 07:01:01.095800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:01:01.095800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:01:01.095800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:01:01.095800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:01:01.095800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:01:01.095800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:01:01.095800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: b5ea0c5e37d54c28b948355d9c4be3f2 Sep 13 07:01:01.095800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-VolumesNegativeTest-617713170 Sep 13 07:01:01.095800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:01:01.095800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:01:01.097133 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b5ea0c5e37d54c28b948355d9c4be3f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5ea0c5e37d54c28b948355d9c4be3f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5ea0c5e37d54c28b948355d9c4be3f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b5ea0c5e37d54c28b948355d9c4be3f2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:01:01.097133 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-VolumesNegativeTest-617713170 Sep 13 07:01:01.097133 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: b5ea0c5e37d54c28b948355d9c4be3f2 Sep 13 07:01:01.097133 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-VolumesNegativeTest-617713170 Sep 13 07:01:01.097133 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-VolumesNegativeTest-617713170-project Sep 13 07:01:01.097133 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:01:01.097133 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:01:01.097133 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 84f133a848ed4f64a2c1bd0fc53c0424 Sep 13 07:01:01.097133 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-VolumesNegativeTest-617713170-project Sep 13 07:01:01.097133 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: Sep 13 07:01:01.097133 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Volume 7e9b6f4d-69ac-4702-bff3-c0b10dce5e70 could not be found. Sep 13 07:01:01.097133 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': '7e9b6f4d-69ac-4702-bff3-c0b10dce5e70'} Sep 13 07:01:01.097133 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:01:01.098013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:01:01.098013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:01:01.098013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:01:01.098013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 07:01:01.098013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 07:01:01.098013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 07:01:01.098013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 07:01:01.098013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 07:01:01.098013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 07:01:01.098013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 07:01:01.098013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 07:01:01.098013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:01:01.098013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:01:01.098013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:01:01.098013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:01:01.098013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7e9b6f4d-69ac-4702-bff3-c0b10dce5e70 could not be found. (HTTP 404) (Request-ID: req-bc022d4e-c8a2-4bc9-b147-ca0ee39c7368) Sep 13 07:01:01.098013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:01:01.098013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:01:01.098013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:01:01.099156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:01:01.099156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 07:01:01.099156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 07:01:01.099156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 07:01:01.099156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 07:01:01.099156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 07:01:01.099156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 07:01:01.099156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 07:01:01.099156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 07:01:01.099156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:01:01.099156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:01:01.099156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 07:01:01.099156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 07:01:01.099156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 07:01:01.099156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 07:01:01.099156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 07:01:01.099156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 07:01:01.099156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 07:01:01.099156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 07:01:01.100223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:01:01.100223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:01:01.100223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:01:01.100223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:01:01.100223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7e9b6f4d-69ac-4702-bff3-c0b10dce5e70 could not be found. Sep 13 07:01:01.100223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:01:01.100223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:01:01.100223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:01:01.100223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:01:01.100223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:01:01.100223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:01:01.100223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:01:01.100223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:01:01.100223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 07:01:01.100223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 07:01:01.100223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:01:01.100223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:01:01.100223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 07:01:01.100223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:01:01.101203 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7e9b6f4d-69ac-4702-bff3-c0b10dce5e70 could not be found. Sep 13 07:01:01.101203 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:01:01.101203 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:01:01.101203 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:01:01.101203 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:01:01.101203 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:01:01.101203 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:01:01.101203 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:01:01.101203 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:01:01.101203 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7e9b6f4d-69ac-4702-bff3-c0b10dce5e70 could not be found. Sep 13 07:01:01.101203 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:01:01.101203 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6ee07616-3318-4786-b627-d0120acd44d2 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] Returning 404 to user: Volume 7e9b6f4d-69ac-4702-bff3-c0b10dce5e70 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:01:01.101203 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6ee07616-3318-4786-b627-d0120acd44d2 tempest-VolumesNegativeTest-617713170 tempest-VolumesNegativeTest-617713170-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/7e9b6f4d-69ac-4702-bff3-c0b10dce5e70" status: 404 len: 109 microversion: 2.1 time: 0.228023 Sep 13 07:01:01.117542 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 6/9] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Sep 13 07:01:00 2022] GET /compute/v2.1/os-volumes/7e9b6f4d-69ac-4702-bff3-c0b10dce5e70 => generated 109 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 07:01:02.812985 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b4acb1c7-c5f2-469a-b960-7a2de6358e13 tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] Calling method '.version_select at 0x7f4c1a4c08b0>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:02.912198 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b4acb1c7-c5f2-469a-b960-7a2de6358e13 tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/428a388a-ef1a-4dcd-8d4f-d79d71449dfa" status: 200 len: 351 microversion: 2.1 time: 0.103361 Sep 13 07:01:02.912915 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 4/10] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Sep 13 07:01:02 2022] GET /compute/v2.1/os-volumes/428a388a-ef1a-4dcd-8d4f-d79d71449dfa => generated 351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:01:07.108927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-09ff3a3a-851b-4ffe-aa35-f12fc2f15018 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Action: 'create', calling method: .version_select at 0x7f4c1a4708b0>, body: {"keypair": {"name": "tempest-keypair-235911165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0CQOVnOs0sXtjVxsPZ6HZ0H8lm4co/Z+eLJFvP90p1wsCK9/b8PnVNwHwG3vpX/w4QO//HdwMeavR8x3IxjIz9ks9kHzDoi/vTEcORHO9qOub4HiIkeOhd8qd0XA/D5w=="}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:01:07.249799 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-623e9200-afb6-418e-9387-8203a1364580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1338170253", "imageRef": "19a6700e-e153-4bea-87aa-036bfccf0ecd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:01:07.279210 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-09ff3a3a-851b-4ffe-aa35-f12fc2f15018 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Getting quotas for project 8c7dc05c1c9d40b2bb0defc9dd157d6e. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:01:07.303180 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-09ff3a3a-851b-4ffe-aa35-f12fc2f15018 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Getting quotas for user 5a0fd7347cad41bc80f427f872cf78fa and project 8c7dc05c1c9d40b2bb0defc9dd157d6e. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:01:07.436459 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-09ff3a3a-851b-4ffe-aa35-f12fc2f15018 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.013622 Sep 13 07:01:07.449925 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 7/11] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Sep 13 07:01:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:01:07.464184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-12082f6d-63a7-4894-88f3-2067ddd8af24 tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] Calling method '.version_select at 0x7f4c1a3ebd30>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:07.574092 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-623e9200-afb6-418e-9387-8203a1364580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] validate_networks() for [('79887e4b-b2f3-4f20-8c5f-af8dc11d6f75', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:01:08.035670 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-12082f6d-63a7-4894-88f3-2067ddd8af24 tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bbc15dc4-ee5f-4768-ba8c-ac59bc65beff" status: 200 len: 351 microversion: 2.1 time: 0.583591 Sep 13 07:01:08.036397 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 8/12] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Sep 13 07:01:07 2022] GET /compute/v2.1/os-volumes/bbc15dc4-ee5f-4768-ba8c-ac59bc65beff => generated 351 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:01:08.059094 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5b0f8fca-86e6-4a84-909c-d873d2fbc3c0 tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] Calling method '.version_select at 0x7f4c1a39e3a0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:08.514276 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5b0f8fca-86e6-4a84-909c-d873d2fbc3c0 tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.466251 Sep 13 07:01:08.524280 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 9/13] 10.222.0.25 () {58 vars in 1134 bytes} [Tue Sep 13 07:01:08 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:01:08.529351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ba29dd83-0877-4a4c-8873-4a5907da8e60 tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] Calling method '.version_select at 0x7f4c1a39ee50>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:08.888078 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ba29dd83-0877-4a4c-8873-4a5907da8e60 tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.362345 Sep 13 07:01:08.888807 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 10/14] 10.222.0.25 () {58 vars in 1149 bytes} [Tue Sep 13 07:01:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:01:08.902868 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e65317d3-1de2-4bf8-b848-a95e14c5c597 tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] Calling method '.version_select at 0x7f4c1a3ebc10>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:09.109832 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e65317d3-1de2-4bf8-b848-a95e14c5c597 tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.210657 Sep 13 07:01:09.110967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 11/15] 10.222.0.25 () {58 vars in 1134 bytes} [Tue Sep 13 07:01:08 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:09.127233 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-29a7579d-d5de-4ca8-84eb-ca3806b8e4a3 tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] Calling method '.version_select at 0x7f4c1a3eb670>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:09.420826 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-623e9200-afb6-418e-9387-8203a1364580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:01:09.422036 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-623e9200-afb6-418e-9387-8203a1364580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:01:09.422687 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-623e9200-afb6-418e-9387-8203a1364580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:01:09.424166 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-623e9200-afb6-418e-9387-8203a1364580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:01:09.424962 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-623e9200-afb6-418e-9387-8203a1364580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:01:09.459894 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-623e9200-afb6-418e-9387-8203a1364580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:09.462837 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-623e9200-afb6-418e-9387-8203a1364580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:09.463510 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-623e9200-afb6-418e-9387-8203a1364580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:09.464494 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-623e9200-afb6-418e-9387-8203a1364580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:09.466955 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-623e9200-afb6-418e-9387-8203a1364580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:09.467616 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-623e9200-afb6-418e-9387-8203a1364580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:09.488973 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-29a7579d-d5de-4ca8-84eb-ca3806b8e4a3 tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.368379 Sep 13 07:01:09.493688 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 12/16] 10.222.0.25 () {58 vars in 1167 bytes} [Tue Sep 13 07:01:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:01:09.509113 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ed99f1c6-fd74-4ea3-9fc5-223b7d688a80 tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] Calling method '.version_select at 0x7f4c1a39eca0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:09.544944 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-623e9200-afb6-418e-9387-8203a1364580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Getting quotas for project 38b6d7b146a34896bb8309e2c51348f8. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:01:09.563388 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-623e9200-afb6-418e-9387-8203a1364580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Getting quotas for user 0d8d0ff010c04d65b36ebe65c1cbbbfd and project 38b6d7b146a34896bb8309e2c51348f8. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:01:09.597173 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-623e9200-afb6-418e-9387-8203a1364580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:01:09.605246 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-623e9200-afb6-418e-9387-8203a1364580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='19a6700e-e153-4bea-87aa-036bfccf0ecd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:01:09.768552 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ed99f1c6-fd74-4ea3-9fc5-223b7d688a80 tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.264314 Sep 13 07:01:09.769495 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 13/17] 10.222.0.25 () {58 vars in 1170 bytes} [Tue Sep 13 07:01:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:01:09.784312 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8e4a0f68-635e-4ec6-bb9f-cb90c105859f tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] Calling method '.version_select at 0x7f4c1a3b51f0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:09.829950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-623e9200-afb6-418e-9387-8203a1364580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.984046 Sep 13 07:01:09.840413 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 5/18] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Sep 13 07:01:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 2998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 07:01:09.851242 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c46cfa47-dbb9-496a-9ec2-82227b254dcc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:09.852313 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c46cfa47-dbb9-496a-9ec2-82227b254dcc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:09.997933 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8e4a0f68-635e-4ec6-bb9f-cb90c105859f tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.218784 Sep 13 07:01:09.998669 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 14/19] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Sep 13 07:01:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:10.016755 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-117400f9-f9fe-405d-a7f8-cd06414ce3d0 tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] Calling method '.version_select at 0x7f4c1a3acc10>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:10.202199 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c46cfa47-dbb9-496a-9ec2-82227b254dcc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:10.254729 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-117400f9-f9fe-405d-a7f8-cd06414ce3d0 tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.242135 Sep 13 07:01:10.255447 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 15/20] 10.222.0.25 () {58 vars in 1188 bytes} [Tue Sep 13 07:01:10 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:01:10.260921 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c46cfa47-dbb9-496a-9ec2-82227b254dcc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1222 microversion: 2.1 time: 0.417927 Sep 13 07:01:10.261852 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 6/21] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:09 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1222 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:10.270138 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3efda342-8b48-4d89-98ea-fb0b81b35041 tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] Calling method '.version_select at 0x7f4c1a3ebe50>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:10.407815 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c2646bb5-f1c4-4ade-bd7b-c81c3d40eb5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1103371556", "imageRef": "19a6700e-e153-4bea-87aa-036bfccf0ecd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:01:10.549357 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3efda342-8b48-4d89-98ea-fb0b81b35041 tempest-VolumesTestJSON-178069462 tempest-VolumesTestJSON-178069462-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.283155 Sep 13 07:01:10.562161 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 16/22] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Sep 13 07:01:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:10.562618 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-c2646bb5-f1c4-4ade-bd7b-c81c3d40eb5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] validate_networks() for [('79887e4b-b2f3-4f20-8c5f-af8dc11d6f75', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:01:12.788803 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5517277c-a773-442b-8f2b-d1ddb74ac3cf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Action: 'create', calling method: .version_select at 0x7f4c1a3b01f0>, body: {"keypair": {"name": "tempest-keypair-538596837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSLFmQRKhZEQyHOPt/8MIdH4sZeoQIsGa3fYu/z6UUlxBoqTwIN9gm3eyiiKHFeGiZklhCuyP0Jrku4I0/7OkpDGkOd75JBpO7YAs856yV2ll4uUr96YlvOe7sU72oR/g=="}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:01:12.835706 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-5517277c-a773-442b-8f2b-d1ddb74ac3cf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Getting quotas for project 5d5ac5d4506943c48f4f7640d97f63c5. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:01:12.850318 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-5517277c-a773-442b-8f2b-d1ddb74ac3cf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Getting quotas for user ecf2dfd9bbe54b3085e9638caf8ad044 and project 5d5ac5d4506943c48f4f7640d97f63c5. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:01:12.927160 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-c2646bb5-f1c4-4ade-bd7b-c81c3d40eb5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:01:12.927160 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-c2646bb5-f1c4-4ade-bd7b-c81c3d40eb5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:01:12.931399 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-c2646bb5-f1c4-4ade-bd7b-c81c3d40eb5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:01:12.931938 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-c2646bb5-f1c4-4ade-bd7b-c81c3d40eb5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:01:12.932308 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5517277c-a773-442b-8f2b-d1ddb74ac3cf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.457244 Sep 13 07:01:12.932432 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-c2646bb5-f1c4-4ade-bd7b-c81c3d40eb5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:01:12.933529 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 17/23] 10.222.0.25 () {62 vars in 1200 bytes} [Tue Sep 13 07:01:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 460 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 13 07:01:12.970179 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c2646bb5-f1c4-4ade-bd7b-c81c3d40eb5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:12.970679 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c2646bb5-f1c4-4ade-bd7b-c81c3d40eb5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:12.977300 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c2646bb5-f1c4-4ade-bd7b-c81c3d40eb5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:12.978344 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c2646bb5-f1c4-4ade-bd7b-c81c3d40eb5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:12.978848 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c2646bb5-f1c4-4ade-bd7b-c81c3d40eb5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:12.979293 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c2646bb5-f1c4-4ade-bd7b-c81c3d40eb5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:13.080776 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-c2646bb5-f1c4-4ade-bd7b-c81c3d40eb5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Getting quotas for project 38b6d7b146a34896bb8309e2c51348f8. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:01:13.090444 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-c2646bb5-f1c4-4ade-bd7b-c81c3d40eb5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Getting quotas for user 0d8d0ff010c04d65b36ebe65c1cbbbfd and project 38b6d7b146a34896bb8309e2c51348f8. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:01:13.124194 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c2646bb5-f1c4-4ade-bd7b-c81c3d40eb5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:01:13.126537 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c2646bb5-f1c4-4ade-bd7b-c81c3d40eb5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='19a6700e-e153-4bea-87aa-036bfccf0ecd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:01:13.191109 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c2646bb5-f1c4-4ade-bd7b-c81c3d40eb5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.786230 Sep 13 07:01:13.194335 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 7/24] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Sep 13 07:01:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 2792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 07:01:13.204633 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-064fd51f-cede-401c-ace5-89d5ffd28805 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:13.206375 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-064fd51f-cede-401c-ace5-89d5ffd28805 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:13.571768 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-064fd51f-cede-401c-ace5-89d5ffd28805 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:13.616387 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-064fd51f-cede-401c-ace5-89d5ffd28805 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1222 microversion: 2.1 time: 0.415236 Sep 13 07:01:13.620253 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 18/25] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:13 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1222 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:14.524822 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-258deac4-b52a-4e56-9fe5-ff69e9796433 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2024898170", "imageRef": "19a6700e-e153-4bea-87aa-036bfccf0ecd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "672f9e05-334a-4483-b823-bb14da4544d0"}], "security_groups": [{"name": "tempest-securitygroup--1220571030"}], "key_name": "tempest-keypair-235911165", "user_data": "}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:01:14.645987 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-83bab758-6fd1-4a15-a119-8eca21f37722 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:14.648797 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-83bab758-6fd1-4a15-a119-8eca21f37722 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:14.975373 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-83bab758-6fd1-4a15-a119-8eca21f37722 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:15.001893 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-83bab758-6fd1-4a15-a119-8eca21f37722 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1222 microversion: 2.1 time: 0.358515 Sep 13 07:01:15.018118 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 19/26] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:14 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1222 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:01:15.111430 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-258deac4-b52a-4e56-9fe5-ff69e9796433 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] validate_networks() for [('672f9e05-334a-4483-b823-bb14da4544d0', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:01:15.948079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-508a68ef-41f2-44a0-a2b6-e5c1bf1deb6e tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1676171912", "imageRef": "19a6700e-e153-4bea-87aa-036bfccf0ecd", "flavorRef": "452", "networks": [{"uuid": "5f4fd977-45fe-407b-8ff6-ed85b95a84e6"}]}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:01:16.177381 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-508a68ef-41f2-44a0-a2b6-e5c1bf1deb6e tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] validate_networks() for [('5f4fd977-45fe-407b-8ff6-ed85b95a84e6', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:01:17.527710 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-258deac4-b52a-4e56-9fe5-ff69e9796433 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:01:17.527710 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-258deac4-b52a-4e56-9fe5-ff69e9796433 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:01:17.528466 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-258deac4-b52a-4e56-9fe5-ff69e9796433 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:01:17.528466 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-258deac4-b52a-4e56-9fe5-ff69e9796433 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:01:17.528880 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-258deac4-b52a-4e56-9fe5-ff69e9796433 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:01:17.563903 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-258deac4-b52a-4e56-9fe5-ff69e9796433 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:17.566809 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-258deac4-b52a-4e56-9fe5-ff69e9796433 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:17.573091 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-258deac4-b52a-4e56-9fe5-ff69e9796433 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:17.575003 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-258deac4-b52a-4e56-9fe5-ff69e9796433 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:17.578633 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-258deac4-b52a-4e56-9fe5-ff69e9796433 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:17.579400 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-258deac4-b52a-4e56-9fe5-ff69e9796433 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:17.691632 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-258deac4-b52a-4e56-9fe5-ff69e9796433 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Getting quotas for project 8c7dc05c1c9d40b2bb0defc9dd157d6e. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:01:17.713479 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-258deac4-b52a-4e56-9fe5-ff69e9796433 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Getting quotas for user 5a0fd7347cad41bc80f427f872cf78fa and project 8c7dc05c1c9d40b2bb0defc9dd157d6e. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:01:17.741060 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-258deac4-b52a-4e56-9fe5-ff69e9796433 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:01:17.748530 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-258deac4-b52a-4e56-9fe5-ff69e9796433 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='19a6700e-e153-4bea-87aa-036bfccf0ecd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:01:17.852780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-258deac4-b52a-4e56-9fe5-ff69e9796433 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.344030 Sep 13 07:01:17.859521 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 8/27] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Sep 13 07:01:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 3352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 07:01:17.870979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-04383d53-e8a0-4677-b951-58813570066e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:17.872641 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-04383d53-e8a0-4677-b951-58813570066e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:17.892902 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-04383d53-e8a0-4677-b951-58813570066e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:17.902117 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-04383d53-e8a0-4677-b951-58813570066e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:17.903614 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-04383d53-e8a0-4677-b951-58813570066e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:17.905764 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-04383d53-e8a0-4677-b951-58813570066e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:17.908497 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-04383d53-e8a0-4677-b951-58813570066e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:17.910901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-04383d53-e8a0-4677-b951-58813570066e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:19.299677 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-04383d53-e8a0-4677-b951-58813570066e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:19.360629 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-04383d53-e8a0-4677-b951-58813570066e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1280 microversion: 2.1 time: 1.494873 Sep 13 07:01:19.364693 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 9/28] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:17 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1280 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:19.383934 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e3c1c7f8-616a-4bee-b57f-a68187bb9a46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:19.385673 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e3c1c7f8-616a-4bee-b57f-a68187bb9a46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:19.433579 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3c1c7f8-616a-4bee-b57f-a68187bb9a46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:19.436983 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3c1c7f8-616a-4bee-b57f-a68187bb9a46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:19.444196 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3c1c7f8-616a-4bee-b57f-a68187bb9a46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:19.444196 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3c1c7f8-616a-4bee-b57f-a68187bb9a46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:19.444196 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3c1c7f8-616a-4bee-b57f-a68187bb9a46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:19.451652 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3c1c7f8-616a-4bee-b57f-a68187bb9a46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:19.744268 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e3c1c7f8-616a-4bee-b57f-a68187bb9a46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:19.754210 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e3c1c7f8-616a-4bee-b57f-a68187bb9a46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1245 microversion: 2.1 time: 0.387985 Sep 13 07:01:19.762322 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 10/29] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:19 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1245 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:20.042368 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-508a68ef-41f2-44a0-a2b6-e5c1bf1deb6e tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:01:20.044944 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-508a68ef-41f2-44a0-a2b6-e5c1bf1deb6e tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:01:20.045878 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-508a68ef-41f2-44a0-a2b6-e5c1bf1deb6e tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:01:20.046718 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-508a68ef-41f2-44a0-a2b6-e5c1bf1deb6e tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:01:20.047824 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-508a68ef-41f2-44a0-a2b6-e5c1bf1deb6e tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:01:20.070240 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-508a68ef-41f2-44a0-a2b6-e5c1bf1deb6e tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:20.071127 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-508a68ef-41f2-44a0-a2b6-e5c1bf1deb6e tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:20.071863 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-508a68ef-41f2-44a0-a2b6-e5c1bf1deb6e tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:20.073540 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-508a68ef-41f2-44a0-a2b6-e5c1bf1deb6e tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:20.077449 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-508a68ef-41f2-44a0-a2b6-e5c1bf1deb6e tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:20.078226 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-508a68ef-41f2-44a0-a2b6-e5c1bf1deb6e tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:20.132479 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-508a68ef-41f2-44a0-a2b6-e5c1bf1deb6e tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Getting quotas for project 5d415383e1c1471aae5712893d48c2b6. Resources: {'instances', 'cores', 'ram'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:01:20.155121 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-508a68ef-41f2-44a0-a2b6-e5c1bf1deb6e tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Getting quotas for user 23088396d0ca47c5929690820a3f7e29 and project 5d415383e1c1471aae5712893d48c2b6. Resources: {'instances', 'cores', 'ram'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:01:20.184174 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-508a68ef-41f2-44a0-a2b6-e5c1bf1deb6e tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:01:20.193243 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-508a68ef-41f2-44a0-a2b6-e5c1bf1deb6e tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='19a6700e-e153-4bea-87aa-036bfccf0ecd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:01:20.390656 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-508a68ef-41f2-44a0-a2b6-e5c1bf1deb6e tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.054991 Sep 13 07:01:20.392186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 20/30] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Sep 13 07:01:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 5057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 07:01:20.407278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-52adaafc-469e-4ad3-bf6f-3440d0834c95 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:20.409005 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-52adaafc-469e-4ad3-bf6f-3440d0834c95 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:20.414766 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7da70a48-1084-42b8-9d03-acc90d90357d tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:20.415582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7da70a48-1084-42b8-9d03-acc90d90357d tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:20.429243 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-52adaafc-469e-4ad3-bf6f-3440d0834c95 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:20.430213 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-52adaafc-469e-4ad3-bf6f-3440d0834c95 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:20.431729 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-52adaafc-469e-4ad3-bf6f-3440d0834c95 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:20.433568 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-52adaafc-469e-4ad3-bf6f-3440d0834c95 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:20.436632 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-52adaafc-469e-4ad3-bf6f-3440d0834c95 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:20.437825 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-52adaafc-469e-4ad3-bf6f-3440d0834c95 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:20.952073 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7da70a48-1084-42b8-9d03-acc90d90357d tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:20.960866 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7da70a48-1084-42b8-9d03-acc90d90357d tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1215 microversion: 2.1 time: 0.557278 Sep 13 07:01:20.980984 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 21/31] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:20 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1215 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:21.001434 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bf4b1e51-fc0e-4c33-a437-479e0e99b215 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:21.004993 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bf4b1e51-fc0e-4c33-a437-479e0e99b215 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:21.026252 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf4b1e51-fc0e-4c33-a437-479e0e99b215 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:21.028008 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf4b1e51-fc0e-4c33-a437-479e0e99b215 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:21.029678 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf4b1e51-fc0e-4c33-a437-479e0e99b215 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:21.030964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf4b1e51-fc0e-4c33-a437-479e0e99b215 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:21.035015 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf4b1e51-fc0e-4c33-a437-479e0e99b215 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:21.038685 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf4b1e51-fc0e-4c33-a437-479e0e99b215 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:21.775864 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bf4b1e51-fc0e-4c33-a437-479e0e99b215 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:21.859626 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bf4b1e51-fc0e-4c33-a437-479e0e99b215 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1293 microversion: 2.1 time: 0.877229 Sep 13 07:01:21.875486 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 22/32] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:20 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1293 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:21.908078 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f1c1624c-9aea-4cc5-9cbe-c564245932f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1011316754", "imageRef": "19a6700e-e153-4bea-87aa-036bfccf0ecd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c3c52b2-50ca-4f89-8b20-12f54380722c"}], "security_groups": [{"name": "tempest-securitygroup--521330802"}], "key_name": "tempest-keypair-538596837", "user_data": "}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:01:22.368833 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-52adaafc-469e-4ad3-bf6f-3440d0834c95 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:22.385314 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-52adaafc-469e-4ad3-bf6f-3440d0834c95 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1322 microversion: 2.1 time: 1.994808 Sep 13 07:01:22.412643 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 11/33] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:20 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1322 bytes in 2025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:22.456738 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-de0e592e-e204-46c5-b1ae-8553323546e1 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:22.465655 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-de0e592e-e204-46c5-b1ae-8553323546e1 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:22.530316 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de0e592e-e204-46c5-b1ae-8553323546e1 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:22.538966 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de0e592e-e204-46c5-b1ae-8553323546e1 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:22.542121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de0e592e-e204-46c5-b1ae-8553323546e1 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:22.543196 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de0e592e-e204-46c5-b1ae-8553323546e1 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:22.549805 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de0e592e-e204-46c5-b1ae-8553323546e1 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:22.552772 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de0e592e-e204-46c5-b1ae-8553323546e1 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:22.746358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-f1c1624c-9aea-4cc5-9cbe-c564245932f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] validate_networks() for [('4c3c52b2-50ca-4f89-8b20-12f54380722c', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:01:23.773613 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-de0e592e-e204-46c5-b1ae-8553323546e1 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:23.796908 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-de0e592e-e204-46c5-b1ae-8553323546e1 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1219 microversion: 2.1 time: 1.383450 Sep 13 07:01:23.797514 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 12/34] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:22 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1219 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:23.852796 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d9ea5630-9daf-4e99-a9d3-0ebf775bac5f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:23.853506 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d9ea5630-9daf-4e99-a9d3-0ebf775bac5f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:23.887382 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d9ea5630-9daf-4e99-a9d3-0ebf775bac5f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:23.887864 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d9ea5630-9daf-4e99-a9d3-0ebf775bac5f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:23.921313 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d9ea5630-9daf-4e99-a9d3-0ebf775bac5f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:23.925360 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d9ea5630-9daf-4e99-a9d3-0ebf775bac5f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:23.928672 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d9ea5630-9daf-4e99-a9d3-0ebf775bac5f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:23.931707 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d9ea5630-9daf-4e99-a9d3-0ebf775bac5f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:25.296183 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d9ea5630-9daf-4e99-a9d3-0ebf775bac5f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:25.316051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d9ea5630-9daf-4e99-a9d3-0ebf775bac5f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1299 microversion: 2.1 time: 1.495223 Sep 13 07:01:25.317225 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 13/35] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:23 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1299 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:25.325740 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c2da9b54-f6c6-49e2-8bba-080773599bd3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:25.326752 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c2da9b54-f6c6-49e2-8bba-080773599bd3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:25.336264 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c2da9b54-f6c6-49e2-8bba-080773599bd3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:25.337130 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c2da9b54-f6c6-49e2-8bba-080773599bd3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:25.337986 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c2da9b54-f6c6-49e2-8bba-080773599bd3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:25.339243 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c2da9b54-f6c6-49e2-8bba-080773599bd3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:25.339967 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c2da9b54-f6c6-49e2-8bba-080773599bd3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:25.340934 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c2da9b54-f6c6-49e2-8bba-080773599bd3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:25.907024 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-f1c1624c-9aea-4cc5-9cbe-c564245932f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:01:25.908182 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-f1c1624c-9aea-4cc5-9cbe-c564245932f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:01:25.909041 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-f1c1624c-9aea-4cc5-9cbe-c564245932f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:01:25.909765 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-f1c1624c-9aea-4cc5-9cbe-c564245932f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:01:25.910405 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-f1c1624c-9aea-4cc5-9cbe-c564245932f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:01:25.921177 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f1c1624c-9aea-4cc5-9cbe-c564245932f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:25.921942 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f1c1624c-9aea-4cc5-9cbe-c564245932f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:25.922602 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f1c1624c-9aea-4cc5-9cbe-c564245932f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:25.923549 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f1c1624c-9aea-4cc5-9cbe-c564245932f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:25.924376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f1c1624c-9aea-4cc5-9cbe-c564245932f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:25.925001 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f1c1624c-9aea-4cc5-9cbe-c564245932f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:25.946540 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-f1c1624c-9aea-4cc5-9cbe-c564245932f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Getting quotas for project 5d5ac5d4506943c48f4f7640d97f63c5. Resources: {'instances', 'cores', 'ram'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:01:25.951258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-f1c1624c-9aea-4cc5-9cbe-c564245932f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Getting quotas for user ecf2dfd9bbe54b3085e9638caf8ad044 and project 5d5ac5d4506943c48f4f7640d97f63c5. Resources: {'instances', 'cores', 'ram'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:01:25.963960 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f1c1624c-9aea-4cc5-9cbe-c564245932f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:01:25.967168 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f1c1624c-9aea-4cc5-9cbe-c564245932f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='19a6700e-e153-4bea-87aa-036bfccf0ecd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:01:26.061133 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c2da9b54-f6c6-49e2-8bba-080773599bd3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:26.072423 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c2da9b54-f6c6-49e2-8bba-080773599bd3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1322 microversion: 2.1 time: 0.752859 Sep 13 07:01:26.073010 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 14/36] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:25 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1322 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:26.090634 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f1c1624c-9aea-4cc5-9cbe-c564245932f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.209551 Sep 13 07:01:26.091319 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 23/37] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Sep 13 07:01:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 4215 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 07:01:26.093667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3d42e812-ae20-4d2d-b412-8a2b786a8ac9 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:26.094509 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3d42e812-ae20-4d2d-b412-8a2b786a8ac9 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:26.100741 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3d42e812-ae20-4d2d-b412-8a2b786a8ac9 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:26.102703 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3d42e812-ae20-4d2d-b412-8a2b786a8ac9 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:26.110365 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3d42e812-ae20-4d2d-b412-8a2b786a8ac9 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:26.111371 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3d42e812-ae20-4d2d-b412-8a2b786a8ac9 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:26.112082 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3d42e812-ae20-4d2d-b412-8a2b786a8ac9 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:26.112676 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3d42e812-ae20-4d2d-b412-8a2b786a8ac9 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:26.203133 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-d5210780-9caa-4f02-99ed-2e42a12c3571 req-d60b09bb-0fe3-4bab-b9f8-65d692cf9fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8082cb10-169b-478f-9b71-7680fe245559", "tag": "827c4775-bb8b-4e51-8c12-4fe64b1bf6ec"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:01:26.247552 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d5210780-9caa-4f02-99ed-2e42a12c3571 req-d60b09bb-0fe3-4bab-b9f8-65d692cf9fc9 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:26.248891 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d5210780-9caa-4f02-99ed-2e42a12c3571 req-d60b09bb-0fe3-4bab-b9f8-65d692cf9fc9 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:26.249957 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d5210780-9caa-4f02-99ed-2e42a12c3571 req-d60b09bb-0fe3-4bab-b9f8-65d692cf9fc9 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:26.262005 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3d42e812-ae20-4d2d-b412-8a2b786a8ac9 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:26.276709 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3d42e812-ae20-4d2d-b412-8a2b786a8ac9 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1273 microversion: 2.1 time: 0.202636 Sep 13 07:01:26.277301 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 15/38] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:26 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1273 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:26.290366 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-d5210780-9caa-4f02-99ed-2e42a12c3571 req-d60b09bb-0fe3-4bab-b9f8-65d692cf9fc9 service nova] Creating event network-changed:827c4775-bb8b-4e51-8c12-4fe64b1bf6ec for instance 8082cb10-169b-478f-9b71-7680fe245559 on hv-cinder-85694 Sep 13 07:01:26.290871 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d5210780-9caa-4f02-99ed-2e42a12c3571 req-d60b09bb-0fe3-4bab-b9f8-65d692cf9fc9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120696) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 07:01:26.291443 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d5210780-9caa-4f02-99ed-2e42a12c3571 req-d60b09bb-0fe3-4bab-b9f8-65d692cf9fc9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120696) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 07:01:26.292685 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cc6df774-f85d-4eca-89ae-e5ff7badb9c9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:26.293825 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cc6df774-f85d-4eca-89ae-e5ff7badb9c9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:26.293953 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c7cf3685-124d-4222-9211-2b1cf6ac8062 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:26.294470 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c7cf3685-124d-4222-9211-2b1cf6ac8062 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:26.295601 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cc6df774-f85d-4eca-89ae-e5ff7badb9c9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:26.296102 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cc6df774-f85d-4eca-89ae-e5ff7badb9c9 None None] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:26.297929 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cc6df774-f85d-4eca-89ae-e5ff7badb9c9 None None] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:26.301032 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cc6df774-f85d-4eca-89ae-e5ff7badb9c9 None None] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:26.321920 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.compute.rpcapi [None req-cc6df774-f85d-4eca-89ae-e5ff7badb9c9 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 07:01:26.323376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cc6df774-f85d-4eca-89ae-e5ff7badb9c9 None None] Releasing lock "compute-rpcapi-router" {{(pid=120696) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 07:01:26.353132 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cc6df774-f85d-4eca-89ae-e5ff7badb9c9 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245243 Sep 13 07:01:26.355836 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 24/39] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:01:26.367030 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5a64fb9e-187c-41db-87d7-96bc3cc0a2fb tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:26.368049 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5a64fb9e-187c-41db-87d7-96bc3cc0a2fb tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:26.403703 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5a64fb9e-187c-41db-87d7-96bc3cc0a2fb tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:26.404212 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5a64fb9e-187c-41db-87d7-96bc3cc0a2fb tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:26.404654 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5a64fb9e-187c-41db-87d7-96bc3cc0a2fb tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:26.405368 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5a64fb9e-187c-41db-87d7-96bc3cc0a2fb tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:26.410690 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5a64fb9e-187c-41db-87d7-96bc3cc0a2fb tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:26.415058 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5a64fb9e-187c-41db-87d7-96bc3cc0a2fb tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:26.453822 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c7cf3685-124d-4222-9211-2b1cf6ac8062 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:26.465713 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c7cf3685-124d-4222-9211-2b1cf6ac8062 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:26.467669 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c7cf3685-124d-4222-9211-2b1cf6ac8062 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:26.470386 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c7cf3685-124d-4222-9211-2b1cf6ac8062 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1281 microversion: 2.20 time: 0.192123 Sep 13 07:01:26.473727 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 16/40] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:01:26 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1281 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:01:26.642073 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5a64fb9e-187c-41db-87d7-96bc3cc0a2fb tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:26.653438 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5a64fb9e-187c-41db-87d7-96bc3cc0a2fb tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1299 microversion: 2.1 time: 0.295548 Sep 13 07:01:26.656787 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 25/41] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:26 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1299 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:27.080961 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-6f559083-41ad-4180-b6fc-60dd0bf3e4ff req-a193f745-44d4-46f2-8908-b22f0a35919a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49b2d57b-6193-4a49-9ff3-334ada85b470", "tag": "8298a4a7-541f-414c-9b75-7bc68d05e531"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:01:27.097261 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4862fa84-7fa0-4e95-b159-11717b2be967 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:27.098688 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4862fa84-7fa0-4e95-b159-11717b2be967 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:27.100558 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-6f559083-41ad-4180-b6fc-60dd0bf3e4ff req-a193f745-44d4-46f2-8908-b22f0a35919a service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:27.101051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-6f559083-41ad-4180-b6fc-60dd0bf3e4ff req-a193f745-44d4-46f2-8908-b22f0a35919a service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:27.101561 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-6f559083-41ad-4180-b6fc-60dd0bf3e4ff req-a193f745-44d4-46f2-8908-b22f0a35919a service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:27.120055 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4862fa84-7fa0-4e95-b159-11717b2be967 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:27.120569 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4862fa84-7fa0-4e95-b159-11717b2be967 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:27.121013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4862fa84-7fa0-4e95-b159-11717b2be967 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:27.123638 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-6f559083-41ad-4180-b6fc-60dd0bf3e4ff req-a193f745-44d4-46f2-8908-b22f0a35919a service nova] Creating event network-changed:8298a4a7-541f-414c-9b75-7bc68d05e531 for instance 49b2d57b-6193-4a49-9ff3-334ada85b470 on hv-cinder-85694 Sep 13 07:01:27.124098 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4862fa84-7fa0-4e95-b159-11717b2be967 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:27.124210 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-6f559083-41ad-4180-b6fc-60dd0bf3e4ff req-a193f745-44d4-46f2-8908-b22f0a35919a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120695) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 07:01:27.124480 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-6f559083-41ad-4180-b6fc-60dd0bf3e4ff req-a193f745-44d4-46f2-8908-b22f0a35919a service nova] Acquired lock "compute-rpcapi-router" {{(pid=120695) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 07:01:27.125678 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82dea1b3-0c3e-475f-8611-071d511a4baa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:27.126379 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82dea1b3-0c3e-475f-8611-071d511a4baa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:27.127376 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82dea1b3-0c3e-475f-8611-071d511a4baa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:27.128417 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4862fa84-7fa0-4e95-b159-11717b2be967 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:27.128793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4862fa84-7fa0-4e95-b159-11717b2be967 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:27.134691 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82dea1b3-0c3e-475f-8611-071d511a4baa None None] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:27.135569 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82dea1b3-0c3e-475f-8611-071d511a4baa None None] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:27.136191 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82dea1b3-0c3e-475f-8611-071d511a4baa None None] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:27.148591 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.compute.rpcapi [None req-82dea1b3-0c3e-475f-8611-071d511a4baa None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 07:01:27.149944 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82dea1b3-0c3e-475f-8611-071d511a4baa None None] Releasing lock "compute-rpcapi-router" {{(pid=120695) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 07:01:27.175280 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-82dea1b3-0c3e-475f-8611-071d511a4baa None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196244 Sep 13 07:01:27.182654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 17/42] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:01:27.304559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5e8801f8-e365-43cd-a192-421263ac0ea2 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:27.305383 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5e8801f8-e365-43cd-a192-421263ac0ea2 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:27.314174 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5e8801f8-e365-43cd-a192-421263ac0ea2 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:27.315774 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5e8801f8-e365-43cd-a192-421263ac0ea2 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:27.323684 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5e8801f8-e365-43cd-a192-421263ac0ea2 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:27.327280 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5e8801f8-e365-43cd-a192-421263ac0ea2 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:27.328166 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5e8801f8-e365-43cd-a192-421263ac0ea2 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:27.328820 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5e8801f8-e365-43cd-a192-421263ac0ea2 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:27.483339 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5e8801f8-e365-43cd-a192-421263ac0ea2 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:27.497236 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4862fa84-7fa0-4e95-b159-11717b2be967 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:27.499614 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5e8801f8-e365-43cd-a192-421263ac0ea2 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1273 microversion: 2.1 time: 0.197699 Sep 13 07:01:27.503057 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 18/43] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:27 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1273 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:27.515245 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4862fa84-7fa0-4e95-b159-11717b2be967 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1322 microversion: 2.1 time: 0.422906 Sep 13 07:01:27.516368 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 26/44] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:27 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1322 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:27.518229 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a0b457b3-fc0d-4d0e-be29-f5759bb05d90 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:27.525088 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a0b457b3-fc0d-4d0e-be29-f5759bb05d90 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:27.528308 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=9 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:27.540912 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a0b457b3-fc0d-4d0e-be29-f5759bb05d90 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:27.541405 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a0b457b3-fc0d-4d0e-be29-f5759bb05d90 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:27.541842 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a0b457b3-fc0d-4d0e-be29-f5759bb05d90 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:27.546764 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a0b457b3-fc0d-4d0e-be29-f5759bb05d90 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:27.547250 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a0b457b3-fc0d-4d0e-be29-f5759bb05d90 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:27.547682 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a0b457b3-fc0d-4d0e-be29-f5759bb05d90 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:27.691117 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f65e58b7-ebd1-43e0-8246-a4e2247f43a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:27.691771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f65e58b7-ebd1-43e0-8246-a4e2247f43a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:27.717288 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f65e58b7-ebd1-43e0-8246-a4e2247f43a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:27.717791 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f65e58b7-ebd1-43e0-8246-a4e2247f43a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:27.721563 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f65e58b7-ebd1-43e0-8246-a4e2247f43a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:27.721994 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a0b457b3-fc0d-4d0e-be29-f5759bb05d90 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:27.723008 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f65e58b7-ebd1-43e0-8246-a4e2247f43a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:27.724959 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f65e58b7-ebd1-43e0-8246-a4e2247f43a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:27.726283 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f65e58b7-ebd1-43e0-8246-a4e2247f43a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:27.731061 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a0b457b3-fc0d-4d0e-be29-f5759bb05d90 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:27.732522 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a0b457b3-fc0d-4d0e-be29-f5759bb05d90 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:27.733655 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a0b457b3-fc0d-4d0e-be29-f5759bb05d90 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1285 microversion: 2.20 time: 0.228567 Sep 13 07:01:27.749088 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 19/45] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:01:27 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1285 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:01:28.528062 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6b9c22d4-1a94-4869-8991-8aedac61e417 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:28.528820 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6b9c22d4-1a94-4869-8991-8aedac61e417 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:28.544065 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6b9c22d4-1a94-4869-8991-8aedac61e417 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:28.544574 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6b9c22d4-1a94-4869-8991-8aedac61e417 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:28.545013 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6b9c22d4-1a94-4869-8991-8aedac61e417 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:28.545740 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6b9c22d4-1a94-4869-8991-8aedac61e417 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:28.546224 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6b9c22d4-1a94-4869-8991-8aedac61e417 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:28.557211 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6b9c22d4-1a94-4869-8991-8aedac61e417 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:29.323029 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6b9c22d4-1a94-4869-8991-8aedac61e417 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:29.355100 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6b9c22d4-1a94-4869-8991-8aedac61e417 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1273 microversion: 2.1 time: 0.809508 Sep 13 07:01:29.360061 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 20/46] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:28 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1273 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:29.401260 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ca7c8320-b89b-4a48-a8e3-6695bf4f154f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:29.401959 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ca7c8320-b89b-4a48-a8e3-6695bf4f154f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:29.447776 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ca7c8320-b89b-4a48-a8e3-6695bf4f154f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:29.448444 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ca7c8320-b89b-4a48-a8e3-6695bf4f154f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:29.448857 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ca7c8320-b89b-4a48-a8e3-6695bf4f154f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:29.449572 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ca7c8320-b89b-4a48-a8e3-6695bf4f154f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:29.450018 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ca7c8320-b89b-4a48-a8e3-6695bf4f154f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:29.475056 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ca7c8320-b89b-4a48-a8e3-6695bf4f154f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:29.992276 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f65e58b7-ebd1-43e0-8246-a4e2247f43a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:30.000226 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f65e58b7-ebd1-43e0-8246-a4e2247f43a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1367 microversion: 2.1 time: 2.320855 Sep 13 07:01:30.020400 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 27/47] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:27 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1367 bytes in 2342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:30.033551 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f2c12827-b6b3-40e1-a5fd-3a6a425ce512 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:30.034388 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f2c12827-b6b3-40e1-a5fd-3a6a425ce512 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:30.055655 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2c12827-b6b3-40e1-a5fd-3a6a425ce512 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:30.056554 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2c12827-b6b3-40e1-a5fd-3a6a425ce512 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:30.057047 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2c12827-b6b3-40e1-a5fd-3a6a425ce512 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:30.057777 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2c12827-b6b3-40e1-a5fd-3a6a425ce512 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:30.058318 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2c12827-b6b3-40e1-a5fd-3a6a425ce512 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:30.058752 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2c12827-b6b3-40e1-a5fd-3a6a425ce512 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:30.310393 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f2c12827-b6b3-40e1-a5fd-3a6a425ce512 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:30.372824 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f2c12827-b6b3-40e1-a5fd-3a6a425ce512 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:30.383321 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f2c12827-b6b3-40e1-a5fd-3a6a425ce512 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:30.396417 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f2c12827-b6b3-40e1-a5fd-3a6a425ce512 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1351 microversion: 2.20 time: 0.374624 Sep 13 07:01:30.416617 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 28/48] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:01:30 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1351 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:01:30.444121 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4010d7f8-cb8f-4508-ad07-5ed646aa4755 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:30.450931 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4010d7f8-cb8f-4508-ad07-5ed646aa4755 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:30.453789 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=8 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:30.481001 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4010d7f8-cb8f-4508-ad07-5ed646aa4755 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:30.483994 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4010d7f8-cb8f-4508-ad07-5ed646aa4755 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:30.485552 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4010d7f8-cb8f-4508-ad07-5ed646aa4755 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:30.487783 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4010d7f8-cb8f-4508-ad07-5ed646aa4755 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:30.489203 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4010d7f8-cb8f-4508-ad07-5ed646aa4755 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:30.490244 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4010d7f8-cb8f-4508-ad07-5ed646aa4755 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:30.809270 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4010d7f8-cb8f-4508-ad07-5ed646aa4755 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:30.819389 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4010d7f8-cb8f-4508-ad07-5ed646aa4755 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1273 microversion: 2.1 time: 0.386952 Sep 13 07:01:30.821261 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 29/49] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:30 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1273 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:30.867849 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ca7c8320-b89b-4a48-a8e3-6695bf4f154f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:30.881164 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ca7c8320-b89b-4a48-a8e3-6695bf4f154f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1322 microversion: 2.1 time: 1.517097 Sep 13 07:01:30.882272 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 21/50] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:29 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1322 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:31.027859 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-313cdf68-b89d-4e9e-9452-801a1eb02e72 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:31.029221 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-313cdf68-b89d-4e9e-9452-801a1eb02e72 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:31.039287 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-313cdf68-b89d-4e9e-9452-801a1eb02e72 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:31.043110 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-313cdf68-b89d-4e9e-9452-801a1eb02e72 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:31.043751 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-313cdf68-b89d-4e9e-9452-801a1eb02e72 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:31.046368 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-313cdf68-b89d-4e9e-9452-801a1eb02e72 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:31.048276 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-313cdf68-b89d-4e9e-9452-801a1eb02e72 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:31.049732 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-313cdf68-b89d-4e9e-9452-801a1eb02e72 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:31.292608 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-313cdf68-b89d-4e9e-9452-801a1eb02e72 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:31.304351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-313cdf68-b89d-4e9e-9452-801a1eb02e72 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1367 microversion: 2.1 time: 0.280430 Sep 13 07:01:31.305586 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 30/51] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:31 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:31.446832 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5c00cfd9-db14-4df2-8435-de0460ff17be tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:31.447475 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5c00cfd9-db14-4df2-8435-de0460ff17be tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:31.454314 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c00cfd9-db14-4df2-8435-de0460ff17be tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:31.454810 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c00cfd9-db14-4df2-8435-de0460ff17be tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:31.455273 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c00cfd9-db14-4df2-8435-de0460ff17be tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:31.455968 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c00cfd9-db14-4df2-8435-de0460ff17be tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:31.456574 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c00cfd9-db14-4df2-8435-de0460ff17be tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:31.457137 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c00cfd9-db14-4df2-8435-de0460ff17be tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:31.539969 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5c00cfd9-db14-4df2-8435-de0460ff17be tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:31.553157 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5c00cfd9-db14-4df2-8435-de0460ff17be tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:31.555180 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5c00cfd9-db14-4df2-8435-de0460ff17be tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:31.556697 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5c00cfd9-db14-4df2-8435-de0460ff17be tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1339 microversion: 2.20 time: 0.117419 Sep 13 07:01:31.557567 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 22/52] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:01:31 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1339 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:01:31.571926 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-4ab2bf79-aa01-4fad-8f2c-15897f340b86 req-9c81b0f9-52e2-4927-914f-b78dab49e592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98fc8f3f-7357-45fd-b982-ea283b3b33dd", "tag": "ef18f87e-b4ae-437d-90c7-0368d0e8dc10"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:01:31.582469 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-4ab2bf79-aa01-4fad-8f2c-15897f340b86 req-9c81b0f9-52e2-4927-914f-b78dab49e592 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:31.582942 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-4ab2bf79-aa01-4fad-8f2c-15897f340b86 req-9c81b0f9-52e2-4927-914f-b78dab49e592 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:31.583482 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-4ab2bf79-aa01-4fad-8f2c-15897f340b86 req-9c81b0f9-52e2-4927-914f-b78dab49e592 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:31.608770 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-4ab2bf79-aa01-4fad-8f2c-15897f340b86 req-9c81b0f9-52e2-4927-914f-b78dab49e592 service nova] Creating event network-changed:ef18f87e-b4ae-437d-90c7-0368d0e8dc10 for instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd on hv-cinder-85694 Sep 13 07:01:31.617080 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-4ab2bf79-aa01-4fad-8f2c-15897f340b86 req-9c81b0f9-52e2-4927-914f-b78dab49e592 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049584 Sep 13 07:01:31.618182 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 31/53] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:01:31.842753 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5caa7f2b-3941-4dad-b98c-cf556d13e532 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:31.843366 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5caa7f2b-3941-4dad-b98c-cf556d13e532 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:31.849576 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5caa7f2b-3941-4dad-b98c-cf556d13e532 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:31.850059 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5caa7f2b-3941-4dad-b98c-cf556d13e532 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:31.850518 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5caa7f2b-3941-4dad-b98c-cf556d13e532 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:31.851207 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5caa7f2b-3941-4dad-b98c-cf556d13e532 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:31.851659 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5caa7f2b-3941-4dad-b98c-cf556d13e532 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:31.852079 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5caa7f2b-3941-4dad-b98c-cf556d13e532 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:31.905094 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-180f5cdc-5887-4668-ae0f-306f12f54130 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:31.906134 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-180f5cdc-5887-4668-ae0f-306f12f54130 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:31.912426 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-180f5cdc-5887-4668-ae0f-306f12f54130 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:31.912906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-180f5cdc-5887-4668-ae0f-306f12f54130 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:31.913340 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-180f5cdc-5887-4668-ae0f-306f12f54130 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:31.914031 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-180f5cdc-5887-4668-ae0f-306f12f54130 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:31.914549 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-180f5cdc-5887-4668-ae0f-306f12f54130 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:31.915193 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-180f5cdc-5887-4668-ae0f-306f12f54130 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:32.052533 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5caa7f2b-3941-4dad-b98c-cf556d13e532 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:32.063749 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5caa7f2b-3941-4dad-b98c-cf556d13e532 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1315 microversion: 2.1 time: 0.224827 Sep 13 07:01:32.064749 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 23/54] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:31 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:32.111503 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-180f5cdc-5887-4668-ae0f-306f12f54130 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:32.119448 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-180f5cdc-5887-4668-ae0f-306f12f54130 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1322 microversion: 2.1 time: 0.218646 Sep 13 07:01:32.120011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 32/55] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:31 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:32.333245 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d95b41df-b092-4152-bfe8-46783bb527eb tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:32.333849 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d95b41df-b092-4152-bfe8-46783bb527eb tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:32.341443 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d95b41df-b092-4152-bfe8-46783bb527eb tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:32.342002 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d95b41df-b092-4152-bfe8-46783bb527eb tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:32.342535 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d95b41df-b092-4152-bfe8-46783bb527eb tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:32.343328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d95b41df-b092-4152-bfe8-46783bb527eb tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:32.343990 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d95b41df-b092-4152-bfe8-46783bb527eb tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:32.344483 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d95b41df-b092-4152-bfe8-46783bb527eb tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:32.490400 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d95b41df-b092-4152-bfe8-46783bb527eb tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:32.498576 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d95b41df-b092-4152-bfe8-46783bb527eb tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1367 microversion: 2.1 time: 0.169986 Sep 13 07:01:32.499139 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 24/56] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:32 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:32.584664 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-38d1b950-8701-46c4-992d-da9a505148e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:32.585167 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-38d1b950-8701-46c4-992d-da9a505148e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:32.592815 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-38d1b950-8701-46c4-992d-da9a505148e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:32.595753 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-38d1b950-8701-46c4-992d-da9a505148e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:32.596404 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-38d1b950-8701-46c4-992d-da9a505148e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:32.597610 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-38d1b950-8701-46c4-992d-da9a505148e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:32.598519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-38d1b950-8701-46c4-992d-da9a505148e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:32.599205 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-38d1b950-8701-46c4-992d-da9a505148e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:32.665419 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-38d1b950-8701-46c4-992d-da9a505148e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:32.674551 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-38d1b950-8701-46c4-992d-da9a505148e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:32.676349 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-38d1b950-8701-46c4-992d-da9a505148e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:32.677171 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-38d1b950-8701-46c4-992d-da9a505148e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1339 microversion: 2.20 time: 0.096941 Sep 13 07:01:32.677735 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 33/57] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:01:32 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1339 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:01:33.087764 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9a6eb533-d87f-403c-b6c0-5020d6a14094 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:33.088398 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9a6eb533-d87f-403c-b6c0-5020d6a14094 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:33.095616 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a6eb533-d87f-403c-b6c0-5020d6a14094 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:33.096105 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a6eb533-d87f-403c-b6c0-5020d6a14094 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:33.096537 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a6eb533-d87f-403c-b6c0-5020d6a14094 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:33.097495 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a6eb533-d87f-403c-b6c0-5020d6a14094 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:33.098035 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a6eb533-d87f-403c-b6c0-5020d6a14094 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:33.098704 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a6eb533-d87f-403c-b6c0-5020d6a14094 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:33.147236 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b5077484-4cbe-4546-bb73-94f1319c85a6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:33.147881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b5077484-4cbe-4546-bb73-94f1319c85a6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:33.155109 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5077484-4cbe-4546-bb73-94f1319c85a6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:33.155619 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5077484-4cbe-4546-bb73-94f1319c85a6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:33.156421 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5077484-4cbe-4546-bb73-94f1319c85a6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:33.157899 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5077484-4cbe-4546-bb73-94f1319c85a6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:33.158382 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5077484-4cbe-4546-bb73-94f1319c85a6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:33.158802 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5077484-4cbe-4546-bb73-94f1319c85a6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:33.339689 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9a6eb533-d87f-403c-b6c0-5020d6a14094 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:33.345294 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=100 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:33.354503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9a6eb533-d87f-403c-b6c0-5020d6a14094 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1315 microversion: 2.1 time: 0.266757 Sep 13 07:01:33.356101 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 25/58] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:33 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:33.376347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b5077484-4cbe-4546-bb73-94f1319c85a6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:33.385065 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b5077484-4cbe-4546-bb73-94f1319c85a6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1322 microversion: 2.1 time: 0.242761 Sep 13 07:01:33.385635 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 34/59] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:33 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:33.523804 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-71e05f6e-ba20-4b8a-9553-5ca4fafae712 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:33.524932 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-71e05f6e-ba20-4b8a-9553-5ca4fafae712 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:33.531960 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-71e05f6e-ba20-4b8a-9553-5ca4fafae712 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:33.532580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-71e05f6e-ba20-4b8a-9553-5ca4fafae712 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:33.533102 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-71e05f6e-ba20-4b8a-9553-5ca4fafae712 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:33.533892 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-71e05f6e-ba20-4b8a-9553-5ca4fafae712 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:33.534590 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-71e05f6e-ba20-4b8a-9553-5ca4fafae712 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:33.535263 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-71e05f6e-ba20-4b8a-9553-5ca4fafae712 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:33.680549 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-71e05f6e-ba20-4b8a-9553-5ca4fafae712 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:33.689143 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-71e05f6e-ba20-4b8a-9553-5ca4fafae712 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1367 microversion: 2.1 time: 0.170341 Sep 13 07:01:33.692021 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 26/60] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:33 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:33.704358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-978df0f3-b202-4a0b-a742-dec453963fb7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:33.705295 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-978df0f3-b202-4a0b-a742-dec453963fb7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:33.711669 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-978df0f3-b202-4a0b-a742-dec453963fb7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:33.712277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-978df0f3-b202-4a0b-a742-dec453963fb7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:33.712709 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-978df0f3-b202-4a0b-a742-dec453963fb7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:33.713413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-978df0f3-b202-4a0b-a742-dec453963fb7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:33.713896 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-978df0f3-b202-4a0b-a742-dec453963fb7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:33.714384 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-978df0f3-b202-4a0b-a742-dec453963fb7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:33.781721 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-978df0f3-b202-4a0b-a742-dec453963fb7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:33.791860 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-978df0f3-b202-4a0b-a742-dec453963fb7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:33.793296 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-978df0f3-b202-4a0b-a742-dec453963fb7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:33.794435 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-978df0f3-b202-4a0b-a742-dec453963fb7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1339 microversion: 2.20 time: 0.095142 Sep 13 07:01:33.795442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 35/61] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:01:33 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1339 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:01:34.378317 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f30da924-b7ba-40a7-b2d6-4c56581dae9a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:34.379407 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f30da924-b7ba-40a7-b2d6-4c56581dae9a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:34.385473 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f30da924-b7ba-40a7-b2d6-4c56581dae9a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:34.385955 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f30da924-b7ba-40a7-b2d6-4c56581dae9a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:34.386589 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f30da924-b7ba-40a7-b2d6-4c56581dae9a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:34.387296 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f30da924-b7ba-40a7-b2d6-4c56581dae9a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:34.387895 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f30da924-b7ba-40a7-b2d6-4c56581dae9a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:34.388303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f30da924-b7ba-40a7-b2d6-4c56581dae9a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:34.409830 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0a45687f-68c1-4522-884e-58260b33396d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:34.410656 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0a45687f-68c1-4522-884e-58260b33396d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:34.418042 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a45687f-68c1-4522-884e-58260b33396d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:34.418876 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a45687f-68c1-4522-884e-58260b33396d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:34.419494 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a45687f-68c1-4522-884e-58260b33396d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:34.420684 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a45687f-68c1-4522-884e-58260b33396d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:34.421316 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a45687f-68c1-4522-884e-58260b33396d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:34.421961 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a45687f-68c1-4522-884e-58260b33396d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:34.599748 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f30da924-b7ba-40a7-b2d6-4c56581dae9a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:34.613211 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f30da924-b7ba-40a7-b2d6-4c56581dae9a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1315 microversion: 2.1 time: 0.238877 Sep 13 07:01:34.613910 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 27/62] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:34 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:34.671879 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0a45687f-68c1-4522-884e-58260b33396d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:34.682336 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0a45687f-68c1-4522-884e-58260b33396d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1322 microversion: 2.1 time: 0.276797 Sep 13 07:01:34.682923 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 36/63] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:34 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:34.713151 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f28b6699-46aa-463a-a323-7b49724b7a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:34.714171 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f28b6699-46aa-463a-a323-7b49724b7a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:34.721796 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f28b6699-46aa-463a-a323-7b49724b7a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:34.722302 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f28b6699-46aa-463a-a323-7b49724b7a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:34.725366 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f28b6699-46aa-463a-a323-7b49724b7a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:34.726210 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f28b6699-46aa-463a-a323-7b49724b7a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:34.726739 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f28b6699-46aa-463a-a323-7b49724b7a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:34.727172 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f28b6699-46aa-463a-a323-7b49724b7a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:34.823642 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1c28f956-976b-4070-8931-805f0146429a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:34.824248 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1c28f956-976b-4070-8931-805f0146429a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:34.834952 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1c28f956-976b-4070-8931-805f0146429a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:34.835439 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1c28f956-976b-4070-8931-805f0146429a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:34.835864 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1c28f956-976b-4070-8931-805f0146429a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:34.836574 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1c28f956-976b-4070-8931-805f0146429a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:34.837022 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1c28f956-976b-4070-8931-805f0146429a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:34.837490 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1c28f956-976b-4070-8931-805f0146429a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:34.915486 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1c28f956-976b-4070-8931-805f0146429a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:34.920075 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f28b6699-46aa-463a-a323-7b49724b7a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:34.924594 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1c28f956-976b-4070-8931-805f0146429a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:34.926299 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1c28f956-976b-4070-8931-805f0146429a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:34.928023 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1c28f956-976b-4070-8931-805f0146429a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1339 microversion: 2.20 time: 0.108781 Sep 13 07:01:34.928575 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 37/64] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:01:34 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1339 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:01:34.938242 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f28b6699-46aa-463a-a323-7b49724b7a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1367 microversion: 2.1 time: 0.220766 Sep 13 07:01:34.938589 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 28/65] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:34 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:35.637481 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a31839c2-e625-4c83-83be-53d728a3c549 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:35.638337 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a31839c2-e625-4c83-83be-53d728a3c549 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:35.645535 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a31839c2-e625-4c83-83be-53d728a3c549 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:35.646247 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a31839c2-e625-4c83-83be-53d728a3c549 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:35.654988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a31839c2-e625-4c83-83be-53d728a3c549 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:35.655885 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a31839c2-e625-4c83-83be-53d728a3c549 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:35.656454 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a31839c2-e625-4c83-83be-53d728a3c549 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:35.656966 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a31839c2-e625-4c83-83be-53d728a3c549 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:35.705586 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c0d070a2-f625-413e-a82a-41378d7e2fb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:35.706214 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c0d070a2-f625-413e-a82a-41378d7e2fb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:35.713766 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0d070a2-f625-413e-a82a-41378d7e2fb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:35.714283 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0d070a2-f625-413e-a82a-41378d7e2fb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:35.714834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0d070a2-f625-413e-a82a-41378d7e2fb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:35.715674 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0d070a2-f625-413e-a82a-41378d7e2fb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:35.716122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0d070a2-f625-413e-a82a-41378d7e2fb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:35.716533 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0d070a2-f625-413e-a82a-41378d7e2fb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:35.841702 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a31839c2-e625-4c83-83be-53d728a3c549 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:35.855841 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a31839c2-e625-4c83-83be-53d728a3c549 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1315 microversion: 2.1 time: 0.222361 Sep 13 07:01:35.864799 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 29/66] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:35 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:35.894637 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c0d070a2-f625-413e-a82a-41378d7e2fb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:35.906502 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c0d070a2-f625-413e-a82a-41378d7e2fb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1322 microversion: 2.1 time: 0.205041 Sep 13 07:01:35.907383 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 38/67] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:35 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:35.954333 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f6fb6eae-78c9-4cc7-a802-244996ab3934 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:35.955236 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f6fb6eae-78c9-4cc7-a802-244996ab3934 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:35.959195 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cce9903a-ed68-41ad-b401-3975b77dd831 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:35.959825 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cce9903a-ed68-41ad-b401-3975b77dd831 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:35.962739 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6fb6eae-78c9-4cc7-a802-244996ab3934 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:35.963484 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6fb6eae-78c9-4cc7-a802-244996ab3934 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:35.964039 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6fb6eae-78c9-4cc7-a802-244996ab3934 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:35.964880 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6fb6eae-78c9-4cc7-a802-244996ab3934 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:35.965469 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6fb6eae-78c9-4cc7-a802-244996ab3934 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:35.966175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6fb6eae-78c9-4cc7-a802-244996ab3934 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:35.973320 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=26 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:35.979257 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce9903a-ed68-41ad-b401-3975b77dd831 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:35.979753 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce9903a-ed68-41ad-b401-3975b77dd831 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:35.980179 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce9903a-ed68-41ad-b401-3975b77dd831 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:35.981052 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce9903a-ed68-41ad-b401-3975b77dd831 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:35.981509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce9903a-ed68-41ad-b401-3975b77dd831 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:35.981931 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce9903a-ed68-41ad-b401-3975b77dd831 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:36.079943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cce9903a-ed68-41ad-b401-3975b77dd831 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:36.083679 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:36.089674 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cce9903a-ed68-41ad-b401-3975b77dd831 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:36.091095 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cce9903a-ed68-41ad-b401-3975b77dd831 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:36.092217 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cce9903a-ed68-41ad-b401-3975b77dd831 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1339 microversion: 2.20 time: 0.138023 Sep 13 07:01:36.092890 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 39/68] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:01:35 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1339 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:01:36.152127 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f6fb6eae-78c9-4cc7-a802-244996ab3934 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:36.160251 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f6fb6eae-78c9-4cc7-a802-244996ab3934 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1367 microversion: 2.1 time: 0.210799 Sep 13 07:01:36.161351 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 30/69] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:35 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:36.881789 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4392514e-6cff-4a41-9342-727fd1362495 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:36.882446 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4392514e-6cff-4a41-9342-727fd1362495 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:36.885629 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=6 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:36.891399 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4392514e-6cff-4a41-9342-727fd1362495 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:36.891963 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4392514e-6cff-4a41-9342-727fd1362495 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:36.892404 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4392514e-6cff-4a41-9342-727fd1362495 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:36.893378 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4392514e-6cff-4a41-9342-727fd1362495 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:36.893660 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4392514e-6cff-4a41-9342-727fd1362495 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:36.894109 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4392514e-6cff-4a41-9342-727fd1362495 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:36.929754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b2009d92-00d0-470f-baef-44527a7c39f2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:36.930471 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b2009d92-00d0-470f-baef-44527a7c39f2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:36.933548 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=22 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:36.941488 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2009d92-00d0-470f-baef-44527a7c39f2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:36.941970 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2009d92-00d0-470f-baef-44527a7c39f2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:36.942427 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2009d92-00d0-470f-baef-44527a7c39f2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:36.943127 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2009d92-00d0-470f-baef-44527a7c39f2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:36.943570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2009d92-00d0-470f-baef-44527a7c39f2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:36.943976 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2009d92-00d0-470f-baef-44527a7c39f2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:37.114039 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4392514e-6cff-4a41-9342-727fd1362495 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:37.128772 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4392514e-6cff-4a41-9342-727fd1362495 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1315 microversion: 2.1 time: 0.253040 Sep 13 07:01:37.129359 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 40/70] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:36 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:37.144628 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-121c54d7-065b-45c5-80c3-d0a3296553ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:37.145347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-121c54d7-065b-45c5-80c3-d0a3296553ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:37.147567 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=8 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:37.157327 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-121c54d7-065b-45c5-80c3-d0a3296553ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:37.157558 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b2009d92-00d0-470f-baef-44527a7c39f2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:37.157829 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-121c54d7-065b-45c5-80c3-d0a3296553ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:37.158313 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-121c54d7-065b-45c5-80c3-d0a3296553ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:37.159020 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-121c54d7-065b-45c5-80c3-d0a3296553ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:37.163819 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-121c54d7-065b-45c5-80c3-d0a3296553ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:37.164271 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-121c54d7-065b-45c5-80c3-d0a3296553ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:37.166998 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b2009d92-00d0-470f-baef-44527a7c39f2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1322 microversion: 2.1 time: 0.241927 Sep 13 07:01:37.167656 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 31/71] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:36 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:01:37.185774 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-cadc9d0f-56ef-4dfb-8e61-2851bcaf5490 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:37.186565 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-cadc9d0f-56ef-4dfb-8e61-2851bcaf5490 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:37.195129 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cadc9d0f-56ef-4dfb-8e61-2851bcaf5490 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:37.195741 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cadc9d0f-56ef-4dfb-8e61-2851bcaf5490 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:37.196239 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cadc9d0f-56ef-4dfb-8e61-2851bcaf5490 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:37.196998 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cadc9d0f-56ef-4dfb-8e61-2851bcaf5490 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:37.197578 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cadc9d0f-56ef-4dfb-8e61-2851bcaf5490 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:37.198056 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cadc9d0f-56ef-4dfb-8e61-2851bcaf5490 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:37.279795 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-121c54d7-065b-45c5-80c3-d0a3296553ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:37.289689 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-121c54d7-065b-45c5-80c3-d0a3296553ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:37.291321 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-121c54d7-065b-45c5-80c3-d0a3296553ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:37.292566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-121c54d7-065b-45c5-80c3-d0a3296553ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1339 microversion: 2.20 time: 0.158695 Sep 13 07:01:37.293139 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 41/72] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:01:37 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1339 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:01:37.579828 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-cadc9d0f-56ef-4dfb-8e61-2851bcaf5490 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:37.588416 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-cadc9d0f-56ef-4dfb-8e61-2851bcaf5490 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1367 microversion: 2.1 time: 0.408655 Sep 13 07:01:37.596589 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 32/73] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:37 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1367 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:01:38.154700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ca5a8162-c5d8-4b0a-84bb-2bf5d99cf497 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:38.156606 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ca5a8162-c5d8-4b0a-84bb-2bf5d99cf497 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:38.168430 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ca5a8162-c5d8-4b0a-84bb-2bf5d99cf497 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:38.169254 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ca5a8162-c5d8-4b0a-84bb-2bf5d99cf497 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:38.169837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ca5a8162-c5d8-4b0a-84bb-2bf5d99cf497 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:38.172352 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ca5a8162-c5d8-4b0a-84bb-2bf5d99cf497 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:38.172999 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ca5a8162-c5d8-4b0a-84bb-2bf5d99cf497 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:38.173610 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ca5a8162-c5d8-4b0a-84bb-2bf5d99cf497 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:38.193094 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2ffb8eac-198e-4dae-865b-0bdda461e1d5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:38.194409 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2ffb8eac-198e-4dae-865b-0bdda461e1d5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:38.202264 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2ffb8eac-198e-4dae-865b-0bdda461e1d5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:38.203001 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2ffb8eac-198e-4dae-865b-0bdda461e1d5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:38.203620 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2ffb8eac-198e-4dae-865b-0bdda461e1d5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:38.204564 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2ffb8eac-198e-4dae-865b-0bdda461e1d5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:38.205215 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2ffb8eac-198e-4dae-865b-0bdda461e1d5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:38.205834 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2ffb8eac-198e-4dae-865b-0bdda461e1d5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:38.389964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ca5a8162-c5d8-4b0a-84bb-2bf5d99cf497 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:38.394508 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2ffb8eac-198e-4dae-865b-0bdda461e1d5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:38.398842 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ca5a8162-c5d8-4b0a-84bb-2bf5d99cf497 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1315 microversion: 2.1 time: 0.250861 Sep 13 07:01:38.410155 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 42/74] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:38 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:38.410155 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-db9a4df4-5dee-4058-b547-e38bc22b00df req-783d3691-b365-428f-9fe1-1ae68effc0c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2626a298-4f0c-4116-aa68-f1799bd7b8de", "tag": "15a6822f-f0d2-48e8-8801-aaf402c83509"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:01:38.413576 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-db9a4df4-5dee-4058-b547-e38bc22b00df req-783d3691-b365-428f-9fe1-1ae68effc0c3 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:38.414312 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-db9a4df4-5dee-4058-b547-e38bc22b00df req-783d3691-b365-428f-9fe1-1ae68effc0c3 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:38.414937 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-db9a4df4-5dee-4058-b547-e38bc22b00df req-783d3691-b365-428f-9fe1-1ae68effc0c3 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:38.418230 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2ffb8eac-198e-4dae-865b-0bdda461e1d5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1322 microversion: 2.1 time: 0.229307 Sep 13 07:01:38.419203 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 33/75] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:38 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:38.424392 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-424a72f0-156a-464c-b3e7-863578360d05 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:38.425140 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-424a72f0-156a-464c-b3e7-863578360d05 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:38.427379 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-db9a4df4-5dee-4058-b547-e38bc22b00df req-783d3691-b365-428f-9fe1-1ae68effc0c3 service nova] Creating event network-changed:15a6822f-f0d2-48e8-8801-aaf402c83509 for instance 2626a298-4f0c-4116-aa68-f1799bd7b8de on hv-cinder-85694 Sep 13 07:01:38.432055 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-424a72f0-156a-464c-b3e7-863578360d05 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:38.432721 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-424a72f0-156a-464c-b3e7-863578360d05 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:38.433163 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-424a72f0-156a-464c-b3e7-863578360d05 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:38.433987 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-424a72f0-156a-464c-b3e7-863578360d05 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:38.434528 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-db9a4df4-5dee-4058-b547-e38bc22b00df req-783d3691-b365-428f-9fe1-1ae68effc0c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033226 Sep 13 07:01:38.434703 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-424a72f0-156a-464c-b3e7-863578360d05 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:38.435228 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 43/76] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:01:38.435625 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-424a72f0-156a-464c-b3e7-863578360d05 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:38.516056 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-424a72f0-156a-464c-b3e7-863578360d05 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:38.527624 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-424a72f0-156a-464c-b3e7-863578360d05 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:38.529097 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-424a72f0-156a-464c-b3e7-863578360d05 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:38.530368 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-424a72f0-156a-464c-b3e7-863578360d05 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1339 microversion: 2.20 time: 0.110069 Sep 13 07:01:38.530927 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 34/77] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:01:38 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1339 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:01:38.612194 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cf815813-a7fd-489c-9de9-486974eb4f13 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:38.612501 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cf815813-a7fd-489c-9de9-486974eb4f13 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:38.618934 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cf815813-a7fd-489c-9de9-486974eb4f13 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:38.619537 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cf815813-a7fd-489c-9de9-486974eb4f13 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:38.619949 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cf815813-a7fd-489c-9de9-486974eb4f13 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:38.620662 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cf815813-a7fd-489c-9de9-486974eb4f13 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:38.621104 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cf815813-a7fd-489c-9de9-486974eb4f13 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:38.621516 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cf815813-a7fd-489c-9de9-486974eb4f13 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:38.767477 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cf815813-a7fd-489c-9de9-486974eb4f13 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:38.776600 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cf815813-a7fd-489c-9de9-486974eb4f13 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1367 microversion: 2.1 time: 0.169177 Sep 13 07:01:38.777210 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 44/78] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:38 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:39.422827 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-685ec162-8008-488f-a5e8-55729c6e4bee tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:39.423551 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-685ec162-8008-488f-a5e8-55729c6e4bee tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:39.434746 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-685ec162-8008-488f-a5e8-55729c6e4bee tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:39.435264 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-685ec162-8008-488f-a5e8-55729c6e4bee tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:39.436299 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-685ec162-8008-488f-a5e8-55729c6e4bee tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:39.437531 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-685ec162-8008-488f-a5e8-55729c6e4bee tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:39.439327 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-685ec162-8008-488f-a5e8-55729c6e4bee tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:39.440901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-685ec162-8008-488f-a5e8-55729c6e4bee tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:39.444507 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0e020790-ac2d-43a0-94b4-2094f334b09b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:39.445921 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0e020790-ac2d-43a0-94b4-2094f334b09b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:39.466328 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0e020790-ac2d-43a0-94b4-2094f334b09b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:39.466328 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0e020790-ac2d-43a0-94b4-2094f334b09b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:39.466328 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0e020790-ac2d-43a0-94b4-2094f334b09b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:39.466328 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0e020790-ac2d-43a0-94b4-2094f334b09b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:39.466766 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0e020790-ac2d-43a0-94b4-2094f334b09b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:39.466766 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0e020790-ac2d-43a0-94b4-2094f334b09b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:39.947415 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-685ec162-8008-488f-a5e8-55729c6e4bee tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:39.960678 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-685ec162-8008-488f-a5e8-55729c6e4bee tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1315 microversion: 2.1 time: 0.540625 Sep 13 07:01:39.962394 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 35/79] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:39 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1315 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:39.971871 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a49c8005-1f60-4b03-b9de-5409c5830963 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:39.972813 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a49c8005-1f60-4b03-b9de-5409c5830963 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:39.983251 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a49c8005-1f60-4b03-b9de-5409c5830963 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:39.983863 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a49c8005-1f60-4b03-b9de-5409c5830963 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:39.984516 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a49c8005-1f60-4b03-b9de-5409c5830963 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:39.998664 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a49c8005-1f60-4b03-b9de-5409c5830963 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:40.000069 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a49c8005-1f60-4b03-b9de-5409c5830963 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:40.000698 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a49c8005-1f60-4b03-b9de-5409c5830963 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:40.079165 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0e020790-ac2d-43a0-94b4-2094f334b09b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:40.091870 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0e020790-ac2d-43a0-94b4-2094f334b09b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1322 microversion: 2.1 time: 0.653937 Sep 13 07:01:40.092477 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 45/80] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:39 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1322 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:40.117820 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-42ef7174-defb-42c7-b31c-fb07f1ed1ebd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:40.118490 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-42ef7174-defb-42c7-b31c-fb07f1ed1ebd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:40.124668 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-42ef7174-defb-42c7-b31c-fb07f1ed1ebd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:40.125142 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-42ef7174-defb-42c7-b31c-fb07f1ed1ebd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:40.125560 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-42ef7174-defb-42c7-b31c-fb07f1ed1ebd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:40.126279 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-42ef7174-defb-42c7-b31c-fb07f1ed1ebd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:40.127424 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-42ef7174-defb-42c7-b31c-fb07f1ed1ebd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:40.128018 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-42ef7174-defb-42c7-b31c-fb07f1ed1ebd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:40.136730 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a49c8005-1f60-4b03-b9de-5409c5830963 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:40.149197 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a49c8005-1f60-4b03-b9de-5409c5830963 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:40.151616 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a49c8005-1f60-4b03-b9de-5409c5830963 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:40.153133 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a49c8005-1f60-4b03-b9de-5409c5830963 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1339 microversion: 2.20 time: 0.189424 Sep 13 07:01:40.154307 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 36/81] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:01:39 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1339 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:01:40.367954 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-42ef7174-defb-42c7-b31c-fb07f1ed1ebd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:40.379848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-42ef7174-defb-42c7-b31c-fb07f1ed1ebd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1367 microversion: 2.1 time: 0.271299 Sep 13 07:01:40.380692 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 46/82] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:40 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:40.989456 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-05248e1a-7067-40c7-8d51-02be33efd3ad tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:40.990722 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-05248e1a-7067-40c7-8d51-02be33efd3ad tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:41.012674 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-05248e1a-7067-40c7-8d51-02be33efd3ad tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:41.015751 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-05248e1a-7067-40c7-8d51-02be33efd3ad tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:41.016898 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-05248e1a-7067-40c7-8d51-02be33efd3ad tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:41.019142 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-05248e1a-7067-40c7-8d51-02be33efd3ad tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:41.020326 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-05248e1a-7067-40c7-8d51-02be33efd3ad tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:41.021555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-05248e1a-7067-40c7-8d51-02be33efd3ad tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:41.118413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a2d5ecf1-ce9a-4a35-8839-92671d911472 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:41.119616 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a2d5ecf1-ce9a-4a35-8839-92671d911472 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:41.126928 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2d5ecf1-ce9a-4a35-8839-92671d911472 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:41.138979 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2d5ecf1-ce9a-4a35-8839-92671d911472 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:41.139689 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2d5ecf1-ce9a-4a35-8839-92671d911472 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:41.140636 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2d5ecf1-ce9a-4a35-8839-92671d911472 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:41.141072 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2d5ecf1-ce9a-4a35-8839-92671d911472 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:41.141509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2d5ecf1-ce9a-4a35-8839-92671d911472 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:41.877348 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-05248e1a-7067-40c7-8d51-02be33efd3ad tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:41.888864 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-05248e1a-7067-40c7-8d51-02be33efd3ad tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1315 microversion: 2.1 time: 0.903507 Sep 13 07:01:41.901990 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 37/83] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:40 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1315 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:41.919355 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9a0842b8-5b15-4657-b220-4aa8ed2473d8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:41.920064 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9a0842b8-5b15-4657-b220-4aa8ed2473d8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:41.926392 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a0842b8-5b15-4657-b220-4aa8ed2473d8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:41.927315 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a0842b8-5b15-4657-b220-4aa8ed2473d8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:41.928015 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a0842b8-5b15-4657-b220-4aa8ed2473d8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:41.929362 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a0842b8-5b15-4657-b220-4aa8ed2473d8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:41.929977 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a0842b8-5b15-4657-b220-4aa8ed2473d8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:41.930566 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a0842b8-5b15-4657-b220-4aa8ed2473d8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:42.002290 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a2d5ecf1-ce9a-4a35-8839-92671d911472 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:42.012539 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a2d5ecf1-ce9a-4a35-8839-92671d911472 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1322 microversion: 2.1 time: 0.897953 Sep 13 07:01:42.013361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 47/84] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:41 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1322 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:42.018784 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-51f67f11-b418-4b76-8a5f-d54f64ce816b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:42.019782 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-51f67f11-b418-4b76-8a5f-d54f64ce816b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:42.029027 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51f67f11-b418-4b76-8a5f-d54f64ce816b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:42.029878 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51f67f11-b418-4b76-8a5f-d54f64ce816b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:42.030602 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51f67f11-b418-4b76-8a5f-d54f64ce816b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:42.031494 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51f67f11-b418-4b76-8a5f-d54f64ce816b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:42.032802 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51f67f11-b418-4b76-8a5f-d54f64ce816b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:42.033484 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51f67f11-b418-4b76-8a5f-d54f64ce816b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:42.602281 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-51f67f11-b418-4b76-8a5f-d54f64ce816b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:42.619524 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-51f67f11-b418-4b76-8a5f-d54f64ce816b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1367 microversion: 2.1 time: 0.604486 Sep 13 07:01:42.620117 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 48/85] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:42 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1367 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:42.634058 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9a0842b8-5b15-4657-b220-4aa8ed2473d8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:42.643987 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9a0842b8-5b15-4657-b220-4aa8ed2473d8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:42.650199 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9a0842b8-5b15-4657-b220-4aa8ed2473d8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:42.651481 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9a0842b8-5b15-4657-b220-4aa8ed2473d8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1406 microversion: 2.20 time: 0.741901 Sep 13 07:01:42.656076 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 38/86] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:01:41 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1406 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:01:42.925966 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-45f63c27-8de9-4fd5-a488-fbf714988a80 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:42.926742 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-45f63c27-8de9-4fd5-a488-fbf714988a80 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:42.936496 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-45f63c27-8de9-4fd5-a488-fbf714988a80 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:42.937248 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-45f63c27-8de9-4fd5-a488-fbf714988a80 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:42.937838 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-45f63c27-8de9-4fd5-a488-fbf714988a80 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:42.938791 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-45f63c27-8de9-4fd5-a488-fbf714988a80 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:42.939620 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-45f63c27-8de9-4fd5-a488-fbf714988a80 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:42.940189 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-45f63c27-8de9-4fd5-a488-fbf714988a80 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:43.039456 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e4bf16f8-b87b-44d3-87dc-61f9d5ef3853 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:43.040057 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e4bf16f8-b87b-44d3-87dc-61f9d5ef3853 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:43.051084 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4bf16f8-b87b-44d3-87dc-61f9d5ef3853 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:43.051661 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4bf16f8-b87b-44d3-87dc-61f9d5ef3853 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:43.052220 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4bf16f8-b87b-44d3-87dc-61f9d5ef3853 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:43.053119 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4bf16f8-b87b-44d3-87dc-61f9d5ef3853 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:43.056428 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4bf16f8-b87b-44d3-87dc-61f9d5ef3853 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:43.057136 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4bf16f8-b87b-44d3-87dc-61f9d5ef3853 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:43.845406 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-45f63c27-8de9-4fd5-a488-fbf714988a80 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:43.861085 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-45f63c27-8de9-4fd5-a488-fbf714988a80 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1315 microversion: 2.1 time: 0.938552 Sep 13 07:01:43.862918 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 49/87] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:42 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1315 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:43.876904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-9ddc35d8-54f3-4c0e-83be-b23e155582f5 req-fe1caabf-1640-4ba7-9a3a-b9d659354a0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d57882a-892f-4b45-a8ec-7b6f4b21b0ad", "tag": "447e368f-71d6-49ce-be81-226ee22458f1"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:01:43.905333 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-9ddc35d8-54f3-4c0e-83be-b23e155582f5 req-fe1caabf-1640-4ba7-9a3a-b9d659354a0a service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:43.906332 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-9ddc35d8-54f3-4c0e-83be-b23e155582f5 req-fe1caabf-1640-4ba7-9a3a-b9d659354a0a service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:43.909747 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-9ddc35d8-54f3-4c0e-83be-b23e155582f5 req-fe1caabf-1640-4ba7-9a3a-b9d659354a0a service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:43.915481 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e4bf16f8-b87b-44d3-87dc-61f9d5ef3853 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:43.924357 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e4bf16f8-b87b-44d3-87dc-61f9d5ef3853 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1322 microversion: 2.1 time: 0.889233 Sep 13 07:01:43.937622 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-9ddc35d8-54f3-4c0e-83be-b23e155582f5 req-fe1caabf-1640-4ba7-9a3a-b9d659354a0a service nova] Creating event network-changed:447e368f-71d6-49ce-be81-226ee22458f1 for instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad on hv-cinder-85694 Sep 13 07:01:43.942349 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 39/88] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:43 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1322 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:43.945807 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-9ddc35d8-54f3-4c0e-83be-b23e155582f5 req-fe1caabf-1640-4ba7-9a3a-b9d659354a0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078046 Sep 13 07:01:43.947081 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 50/89] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:01:43.952394 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ed0816ad-812b-406d-8000-f44f5f0f570a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:43.953271 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ed0816ad-812b-406d-8000-f44f5f0f570a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:43.953415 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cd4477ee-c0a9-4f33-987f-08e8dbb66469 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:43.954246 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cd4477ee-c0a9-4f33-987f-08e8dbb66469 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:43.981436 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed0816ad-812b-406d-8000-f44f5f0f570a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:43.984039 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cd4477ee-c0a9-4f33-987f-08e8dbb66469 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:43.987673 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed0816ad-812b-406d-8000-f44f5f0f570a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:43.988471 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cd4477ee-c0a9-4f33-987f-08e8dbb66469 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:43.989143 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed0816ad-812b-406d-8000-f44f5f0f570a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:43.990056 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cd4477ee-c0a9-4f33-987f-08e8dbb66469 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:43.992818 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cd4477ee-c0a9-4f33-987f-08e8dbb66469 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:43.995210 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed0816ad-812b-406d-8000-f44f5f0f570a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:43.996142 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cd4477ee-c0a9-4f33-987f-08e8dbb66469 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:43.996495 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed0816ad-812b-406d-8000-f44f5f0f570a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:43.997765 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed0816ad-812b-406d-8000-f44f5f0f570a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:43.998532 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cd4477ee-c0a9-4f33-987f-08e8dbb66469 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:44.589087 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cd4477ee-c0a9-4f33-987f-08e8dbb66469 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:44.602156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cd4477ee-c0a9-4f33-987f-08e8dbb66469 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:44.604072 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cd4477ee-c0a9-4f33-987f-08e8dbb66469 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:44.619427 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ed0816ad-812b-406d-8000-f44f5f0f570a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:44.632915 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cd4477ee-c0a9-4f33-987f-08e8dbb66469 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1406 microversion: 2.20 time: 0.684209 Sep 13 07:01:44.636609 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 51/90] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:01:43 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1406 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:01:44.653502 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ed0816ad-812b-406d-8000-f44f5f0f570a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1367 microversion: 2.1 time: 0.698702 Sep 13 07:01:44.655927 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 40/91] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:43 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1367 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:44.899122 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b5e21263-3908-4af5-8c36-c32d8e6ca246 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:44.899872 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-3d7c4bda-363c-437b-b0ce-d32b1563663a req-72755864-508d-4b1e-b70c-6bbe6286fe28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8082cb10-169b-478f-9b71-7680fe245559", "name": "network-vif-plugged", "status": "completed", "tag": "827c4775-bb8b-4e51-8c12-4fe64b1bf6ec"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:01:44.901349 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b5e21263-3908-4af5-8c36-c32d8e6ca246 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:44.920595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b5e21263-3908-4af5-8c36-c32d8e6ca246 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:44.924569 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b5e21263-3908-4af5-8c36-c32d8e6ca246 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:44.925133 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b5e21263-3908-4af5-8c36-c32d8e6ca246 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:44.925852 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b5e21263-3908-4af5-8c36-c32d8e6ca246 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:44.928962 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3d7c4bda-363c-437b-b0ce-d32b1563663a req-72755864-508d-4b1e-b70c-6bbe6286fe28 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:44.929381 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b5e21263-3908-4af5-8c36-c32d8e6ca246 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:44.930007 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b5e21263-3908-4af5-8c36-c32d8e6ca246 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:44.934707 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3d7c4bda-363c-437b-b0ce-d32b1563663a req-72755864-508d-4b1e-b70c-6bbe6286fe28 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:44.935181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3d7c4bda-363c-437b-b0ce-d32b1563663a req-72755864-508d-4b1e-b70c-6bbe6286fe28 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:44.962674 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-3d7c4bda-363c-437b-b0ce-d32b1563663a req-72755864-508d-4b1e-b70c-6bbe6286fe28 service nova] Creating event network-vif-plugged:827c4775-bb8b-4e51-8c12-4fe64b1bf6ec for instance 8082cb10-169b-478f-9b71-7680fe245559 on hv-cinder-85694 Sep 13 07:01:44.981426 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-3d7c4bda-363c-437b-b0ce-d32b1563663a req-72755864-508d-4b1e-b70c-6bbe6286fe28 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.342143 Sep 13 07:01:44.983125 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 52/92] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:01:44.992393 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c5058dd6-d1d7-49c3-a11f-48178d062ddd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:44.995205 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c5058dd6-d1d7-49c3-a11f-48178d062ddd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:45.012920 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c5058dd6-d1d7-49c3-a11f-48178d062ddd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:45.014159 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c5058dd6-d1d7-49c3-a11f-48178d062ddd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:45.014835 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c5058dd6-d1d7-49c3-a11f-48178d062ddd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:45.016998 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c5058dd6-d1d7-49c3-a11f-48178d062ddd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:45.018308 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c5058dd6-d1d7-49c3-a11f-48178d062ddd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:45.019589 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c5058dd6-d1d7-49c3-a11f-48178d062ddd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:45.182073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b5e21263-3908-4af5-8c36-c32d8e6ca246 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:45.190947 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b5e21263-3908-4af5-8c36-c32d8e6ca246 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1315 microversion: 2.1 time: 0.308919 Sep 13 07:01:45.202656 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 41/93] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:44 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:45.279091 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c5058dd6-d1d7-49c3-a11f-48178d062ddd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:45.291352 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c5058dd6-d1d7-49c3-a11f-48178d062ddd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1322 microversion: 2.1 time: 0.306505 Sep 13 07:01:45.292915 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 53/94] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:44 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:45.662186 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2c0c3302-72e8-48da-b701-c95f47fc7e30 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:45.662813 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2c0c3302-72e8-48da-b701-c95f47fc7e30 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:45.669136 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2c0c3302-72e8-48da-b701-c95f47fc7e30 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:45.669996 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2c0c3302-72e8-48da-b701-c95f47fc7e30 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:45.670900 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2c0c3302-72e8-48da-b701-c95f47fc7e30 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:45.671663 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2c0c3302-72e8-48da-b701-c95f47fc7e30 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:45.672117 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2c0c3302-72e8-48da-b701-c95f47fc7e30 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:45.674463 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2c0c3302-72e8-48da-b701-c95f47fc7e30 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:45.680239 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-88bdf63a-a107-4a54-9746-d00fc15da3de tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:45.681720 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-88bdf63a-a107-4a54-9746-d00fc15da3de tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:45.689982 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88bdf63a-a107-4a54-9746-d00fc15da3de tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:45.690590 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88bdf63a-a107-4a54-9746-d00fc15da3de tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:45.691050 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88bdf63a-a107-4a54-9746-d00fc15da3de tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:45.691952 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88bdf63a-a107-4a54-9746-d00fc15da3de tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:45.692447 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88bdf63a-a107-4a54-9746-d00fc15da3de tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:45.692863 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88bdf63a-a107-4a54-9746-d00fc15da3de tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:45.702040 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=100 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:46.131528 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-88bdf63a-a107-4a54-9746-d00fc15da3de tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:46.142194 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-88bdf63a-a107-4a54-9746-d00fc15da3de tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1367 microversion: 2.1 time: 0.466979 Sep 13 07:01:46.146652 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 54/95] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:45 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:01:46.148809 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2c0c3302-72e8-48da-b701-c95f47fc7e30 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:46.164258 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2c0c3302-72e8-48da-b701-c95f47fc7e30 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:46.166686 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2c0c3302-72e8-48da-b701-c95f47fc7e30 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:46.168329 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2c0c3302-72e8-48da-b701-c95f47fc7e30 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1406 microversion: 2.20 time: 0.510773 Sep 13 07:01:46.169220 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 42/96] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:01:45 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1406 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:01:46.225425 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-aeacc2fc-0379-4aa8-9d84-cdea78d953df tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:46.226519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-aeacc2fc-0379-4aa8-9d84-cdea78d953df tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:46.241982 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aeacc2fc-0379-4aa8-9d84-cdea78d953df tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:46.242532 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aeacc2fc-0379-4aa8-9d84-cdea78d953df tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:46.242972 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aeacc2fc-0379-4aa8-9d84-cdea78d953df tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:46.243690 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aeacc2fc-0379-4aa8-9d84-cdea78d953df tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:46.246910 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aeacc2fc-0379-4aa8-9d84-cdea78d953df tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:46.249379 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aeacc2fc-0379-4aa8-9d84-cdea78d953df tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:46.315674 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-12bb041e-2ee7-4fd6-b5b9-8bb9f9698115 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:46.318318 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-12bb041e-2ee7-4fd6-b5b9-8bb9f9698115 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:46.329541 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12bb041e-2ee7-4fd6-b5b9-8bb9f9698115 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:46.331275 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12bb041e-2ee7-4fd6-b5b9-8bb9f9698115 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:46.333082 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12bb041e-2ee7-4fd6-b5b9-8bb9f9698115 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:46.334607 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12bb041e-2ee7-4fd6-b5b9-8bb9f9698115 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:46.336932 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12bb041e-2ee7-4fd6-b5b9-8bb9f9698115 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:46.337840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12bb041e-2ee7-4fd6-b5b9-8bb9f9698115 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:46.875792 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-aeacc2fc-0379-4aa8-9d84-cdea78d953df tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:46.885775 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-aeacc2fc-0379-4aa8-9d84-cdea78d953df tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1315 microversion: 2.1 time: 0.664588 Sep 13 07:01:46.903255 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 55/97] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:46 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1315 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:46.976422 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-12bb041e-2ee7-4fd6-b5b9-8bb9f9698115 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:46.988465 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-12bb041e-2ee7-4fd6-b5b9-8bb9f9698115 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1322 microversion: 2.1 time: 0.676853 Sep 13 07:01:46.992165 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 43/98] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:46 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1322 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:01:47.171292 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-607ec75a-f6be-4805-b638-0859b6057991 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:47.171946 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-607ec75a-f6be-4805-b638-0859b6057991 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:47.185116 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-607ec75a-f6be-4805-b638-0859b6057991 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:47.185742 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-607ec75a-f6be-4805-b638-0859b6057991 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:47.188314 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-607ec75a-f6be-4805-b638-0859b6057991 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:47.189269 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-607ec75a-f6be-4805-b638-0859b6057991 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:47.189885 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-607ec75a-f6be-4805-b638-0859b6057991 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:47.190378 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-607ec75a-f6be-4805-b638-0859b6057991 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:47.196324 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-de9f69db-cb24-4d2f-9b8c-6a0e0daaa444 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:47.197620 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-de9f69db-cb24-4d2f-9b8c-6a0e0daaa444 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:47.212990 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de9f69db-cb24-4d2f-9b8c-6a0e0daaa444 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:47.213712 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de9f69db-cb24-4d2f-9b8c-6a0e0daaa444 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:47.214446 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de9f69db-cb24-4d2f-9b8c-6a0e0daaa444 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:47.215208 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de9f69db-cb24-4d2f-9b8c-6a0e0daaa444 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:47.215671 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de9f69db-cb24-4d2f-9b8c-6a0e0daaa444 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:47.216113 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de9f69db-cb24-4d2f-9b8c-6a0e0daaa444 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:47.429826 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-607ec75a-f6be-4805-b638-0859b6057991 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:47.441590 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-607ec75a-f6be-4805-b638-0859b6057991 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1367 microversion: 2.1 time: 0.279043 Sep 13 07:01:47.441808 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-de9f69db-cb24-4d2f-9b8c-6a0e0daaa444 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:47.442272 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 56/99] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:47 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:47.466662 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-de9f69db-cb24-4d2f-9b8c-6a0e0daaa444 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:47.468172 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-de9f69db-cb24-4d2f-9b8c-6a0e0daaa444 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:47.469684 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-de9f69db-cb24-4d2f-9b8c-6a0e0daaa444 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1406 microversion: 2.20 time: 0.278375 Sep 13 07:01:47.470796 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 44/100] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:01:47 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:01:47.915430 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1cef9016-6d9b-4af2-aa74-de9030d7d7d0 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:47.916835 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1cef9016-6d9b-4af2-aa74-de9030d7d7d0 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:47.925346 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-b492e1c5-4b83-4b89-b49a-64801e02ce24 req-ad10305a-8a3f-4c1b-bd5b-854f94a2ab35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98fc8f3f-7357-45fd-b982-ea283b3b33dd", "name": "network-vif-plugged", "status": "completed", "tag": "ef18f87e-b4ae-437d-90c7-0368d0e8dc10"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:01:47.946448 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1cef9016-6d9b-4af2-aa74-de9030d7d7d0 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:47.946962 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1cef9016-6d9b-4af2-aa74-de9030d7d7d0 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:47.947398 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1cef9016-6d9b-4af2-aa74-de9030d7d7d0 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:47.948204 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1cef9016-6d9b-4af2-aa74-de9030d7d7d0 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:47.948692 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1cef9016-6d9b-4af2-aa74-de9030d7d7d0 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:47.949117 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1cef9016-6d9b-4af2-aa74-de9030d7d7d0 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:47.959757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-b492e1c5-4b83-4b89-b49a-64801e02ce24 req-ad10305a-8a3f-4c1b-bd5b-854f94a2ab35 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:47.960236 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-b492e1c5-4b83-4b89-b49a-64801e02ce24 req-ad10305a-8a3f-4c1b-bd5b-854f94a2ab35 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:47.960687 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-b492e1c5-4b83-4b89-b49a-64801e02ce24 req-ad10305a-8a3f-4c1b-bd5b-854f94a2ab35 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:47.993732 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-b492e1c5-4b83-4b89-b49a-64801e02ce24 req-ad10305a-8a3f-4c1b-bd5b-854f94a2ab35 service nova] Creating event network-vif-plugged:ef18f87e-b4ae-437d-90c7-0368d0e8dc10 for instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd on hv-cinder-85694 Sep 13 07:01:48.007337 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-b492e1c5-4b83-4b89-b49a-64801e02ce24 req-ad10305a-8a3f-4c1b-bd5b-854f94a2ab35 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084825 Sep 13 07:01:48.009092 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 45/101] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:01:48.021835 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f3db1b60-a53d-443c-87a9-015bdab626af tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:48.022558 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f3db1b60-a53d-443c-87a9-015bdab626af tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:48.035993 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3db1b60-a53d-443c-87a9-015bdab626af tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:48.036698 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3db1b60-a53d-443c-87a9-015bdab626af tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:48.049559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3db1b60-a53d-443c-87a9-015bdab626af tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:48.050901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3db1b60-a53d-443c-87a9-015bdab626af tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:48.051404 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3db1b60-a53d-443c-87a9-015bdab626af tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:48.053614 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3db1b60-a53d-443c-87a9-015bdab626af tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:48.330638 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1cef9016-6d9b-4af2-aa74-de9030d7d7d0 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:48.348571 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1cef9016-6d9b-4af2-aa74-de9030d7d7d0 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1315 microversion: 2.1 time: 0.437944 Sep 13 07:01:48.349449 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 57/102] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:47 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:48.466145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f3db1b60-a53d-443c-87a9-015bdab626af tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:48.473383 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bbed68af-1998-4855-b0c8-4d12d247f1fa tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:48.475039 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bbed68af-1998-4855-b0c8-4d12d247f1fa tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:48.476896 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f3db1b60-a53d-443c-87a9-015bdab626af tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1322 microversion: 2.1 time: 0.464619 Sep 13 07:01:48.477936 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 46/103] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:48 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1322 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:48.489084 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbed68af-1998-4855-b0c8-4d12d247f1fa tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:48.495530 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbed68af-1998-4855-b0c8-4d12d247f1fa tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:48.496094 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbed68af-1998-4855-b0c8-4d12d247f1fa tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:48.496970 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbed68af-1998-4855-b0c8-4d12d247f1fa tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:48.497393 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbed68af-1998-4855-b0c8-4d12d247f1fa tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:48.497807 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbed68af-1998-4855-b0c8-4d12d247f1fa tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:48.498297 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8ee239ca-6c20-4a0b-a808-a641a182890c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:48.499113 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8ee239ca-6c20-4a0b-a808-a641a182890c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:48.512847 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8ee239ca-6c20-4a0b-a808-a641a182890c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:48.514523 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8ee239ca-6c20-4a0b-a808-a641a182890c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:48.516500 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8ee239ca-6c20-4a0b-a808-a641a182890c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:48.517705 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8ee239ca-6c20-4a0b-a808-a641a182890c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:48.521573 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8ee239ca-6c20-4a0b-a808-a641a182890c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:48.522295 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8ee239ca-6c20-4a0b-a808-a641a182890c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:48.580956 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:48.833668 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bbed68af-1998-4855-b0c8-4d12d247f1fa tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:48.838232 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8ee239ca-6c20-4a0b-a808-a641a182890c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:48.850388 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8ee239ca-6c20-4a0b-a808-a641a182890c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:48.851588 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bbed68af-1998-4855-b0c8-4d12d247f1fa tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1367 microversion: 2.1 time: 0.384882 Sep 13 07:01:48.852135 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 58/104] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:48 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1367 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:01:48.852667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8ee239ca-6c20-4a0b-a808-a641a182890c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:48.854052 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8ee239ca-6c20-4a0b-a808-a641a182890c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1406 microversion: 2.20 time: 0.362424 Sep 13 07:01:48.866872 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 47/105] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:01:48 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1406 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:01:49.376681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4b657d2e-1a19-49e2-8147-0df0e80abe71 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:49.377285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4b657d2e-1a19-49e2-8147-0df0e80abe71 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:49.394690 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b657d2e-1a19-49e2-8147-0df0e80abe71 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:49.394690 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b657d2e-1a19-49e2-8147-0df0e80abe71 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:49.394690 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b657d2e-1a19-49e2-8147-0df0e80abe71 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:49.394690 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b657d2e-1a19-49e2-8147-0df0e80abe71 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:49.395276 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b657d2e-1a19-49e2-8147-0df0e80abe71 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:49.395276 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b657d2e-1a19-49e2-8147-0df0e80abe71 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:49.511184 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bd7ba909-754a-4bdb-8ac1-95008a40dda9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:49.512232 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bd7ba909-754a-4bdb-8ac1-95008a40dda9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:49.529564 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bd7ba909-754a-4bdb-8ac1-95008a40dda9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:49.530115 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bd7ba909-754a-4bdb-8ac1-95008a40dda9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:49.531148 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bd7ba909-754a-4bdb-8ac1-95008a40dda9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:49.532113 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bd7ba909-754a-4bdb-8ac1-95008a40dda9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:49.532461 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bd7ba909-754a-4bdb-8ac1-95008a40dda9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:49.533321 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bd7ba909-754a-4bdb-8ac1-95008a40dda9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:49.924986 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4b657d2e-1a19-49e2-8147-0df0e80abe71 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:49.935782 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4b657d2e-1a19-49e2-8147-0df0e80abe71 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1315 microversion: 2.1 time: 0.563435 Sep 13 07:01:49.936386 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 59/106] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:49 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1315 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:49.951107 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f6dd9b83-c40e-44f5-99d5-1fcce8873dcf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:49.951107 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f6dd9b83-c40e-44f5-99d5-1fcce8873dcf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:49.964650 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6dd9b83-c40e-44f5-99d5-1fcce8873dcf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:49.965147 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6dd9b83-c40e-44f5-99d5-1fcce8873dcf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:49.965572 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6dd9b83-c40e-44f5-99d5-1fcce8873dcf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:49.966307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6dd9b83-c40e-44f5-99d5-1fcce8873dcf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:49.966750 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6dd9b83-c40e-44f5-99d5-1fcce8873dcf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:49.967163 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6dd9b83-c40e-44f5-99d5-1fcce8873dcf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:50.112726 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bd7ba909-754a-4bdb-8ac1-95008a40dda9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:50.120459 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bd7ba909-754a-4bdb-8ac1-95008a40dda9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1322 microversion: 2.1 time: 0.621212 Sep 13 07:01:50.121048 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 48/107] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:49 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1322 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:50.133370 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-364e63c0-d32c-41e8-8fa3-e121bb8a09fe tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:50.133988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-364e63c0-d32c-41e8-8fa3-e121bb8a09fe tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:50.149249 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-364e63c0-d32c-41e8-8fa3-e121bb8a09fe tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:50.149746 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-364e63c0-d32c-41e8-8fa3-e121bb8a09fe tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:50.150392 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-364e63c0-d32c-41e8-8fa3-e121bb8a09fe tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:50.151229 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-364e63c0-d32c-41e8-8fa3-e121bb8a09fe tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:50.151819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-364e63c0-d32c-41e8-8fa3-e121bb8a09fe tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:50.152384 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-364e63c0-d32c-41e8-8fa3-e121bb8a09fe tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:50.239018 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f6dd9b83-c40e-44f5-99d5-1fcce8873dcf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:50.251091 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f6dd9b83-c40e-44f5-99d5-1fcce8873dcf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:50.262158 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f6dd9b83-c40e-44f5-99d5-1fcce8873dcf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:50.266687 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f6dd9b83-c40e-44f5-99d5-1fcce8873dcf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1406 microversion: 2.20 time: 0.324663 Sep 13 07:01:50.267780 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 60/108] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:01:49 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1406 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:01:50.275602 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-ca8ca029-2f00-4a86-8e19-734337336e2a req-66a1a7e7-4b9c-4f28-b049-9ec495b5e3db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b2d57b-6193-4a49-9ff3-334ada85b470", "name": "network-vif-plugged", "status": "completed", "tag": "8298a4a7-541f-414c-9b75-7bc68d05e531"}, {"server_uuid": "2626a298-4f0c-4116-aa68-f1799bd7b8de", "name": "network-vif-plugged", "status": "completed", "tag": "15a6822f-f0d2-48e8-8801-aaf402c83509"}, {"server_uuid": "5d57882a-892f-4b45-a8ec-7b6f4b21b0ad", "name": "network-vif-plugged", "status": "completed", "tag": "447e368f-71d6-49ce-be81-226ee22458f1"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:01:50.325219 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-ca8ca029-2f00-4a86-8e19-734337336e2a req-66a1a7e7-4b9c-4f28-b049-9ec495b5e3db service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:50.325537 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-ca8ca029-2f00-4a86-8e19-734337336e2a req-66a1a7e7-4b9c-4f28-b049-9ec495b5e3db service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:50.325968 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-ca8ca029-2f00-4a86-8e19-734337336e2a req-66a1a7e7-4b9c-4f28-b049-9ec495b5e3db service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:50.364701 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-ca8ca029-2f00-4a86-8e19-734337336e2a req-66a1a7e7-4b9c-4f28-b049-9ec495b5e3db service nova] Creating event network-vif-plugged:8298a4a7-541f-414c-9b75-7bc68d05e531 for instance 49b2d57b-6193-4a49-9ff3-334ada85b470 on hv-cinder-85694 Sep 13 07:01:50.365539 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-ca8ca029-2f00-4a86-8e19-734337336e2a req-66a1a7e7-4b9c-4f28-b049-9ec495b5e3db service nova] Creating event network-vif-plugged:15a6822f-f0d2-48e8-8801-aaf402c83509 for instance 2626a298-4f0c-4116-aa68-f1799bd7b8de on hv-cinder-85694 Sep 13 07:01:50.375758 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-ca8ca029-2f00-4a86-8e19-734337336e2a req-66a1a7e7-4b9c-4f28-b049-9ec495b5e3db service nova] Creating event network-vif-plugged:447e368f-71d6-49ce-be81-226ee22458f1 for instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad on hv-cinder-85694 Sep 13 07:01:50.384542 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-ca8ca029-2f00-4a86-8e19-734337336e2a req-66a1a7e7-4b9c-4f28-b049-9ec495b5e3db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.115741 Sep 13 07:01:50.385983 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 61/109] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:01:50.400093 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-364e63c0-d32c-41e8-8fa3-e121bb8a09fe tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:50.411479 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-364e63c0-d32c-41e8-8fa3-e121bb8a09fe tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1367 microversion: 2.1 time: 0.284905 Sep 13 07:01:50.412236 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 49/110] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:50 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:50.964849 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a4751a71-6c59-4903-ac2b-04fd239322d8 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:50.965648 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a4751a71-6c59-4903-ac2b-04fd239322d8 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:50.978948 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a4751a71-6c59-4903-ac2b-04fd239322d8 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:50.979709 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a4751a71-6c59-4903-ac2b-04fd239322d8 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:50.981817 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a4751a71-6c59-4903-ac2b-04fd239322d8 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:50.984213 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a4751a71-6c59-4903-ac2b-04fd239322d8 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:50.984760 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a4751a71-6c59-4903-ac2b-04fd239322d8 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:50.985843 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a4751a71-6c59-4903-ac2b-04fd239322d8 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:51.150255 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ef2f17a7-5963-4720-a47f-cc60442f239c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:51.154853 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ef2f17a7-5963-4720-a47f-cc60442f239c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:51.173061 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ef2f17a7-5963-4720-a47f-cc60442f239c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:51.173666 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ef2f17a7-5963-4720-a47f-cc60442f239c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:51.174136 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ef2f17a7-5963-4720-a47f-cc60442f239c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:51.182922 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ef2f17a7-5963-4720-a47f-cc60442f239c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:51.183416 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ef2f17a7-5963-4720-a47f-cc60442f239c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:51.183850 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ef2f17a7-5963-4720-a47f-cc60442f239c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:51.327487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a4751a71-6c59-4903-ac2b-04fd239322d8 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:51.340547 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a4751a71-6c59-4903-ac2b-04fd239322d8 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1315 microversion: 2.1 time: 0.379987 Sep 13 07:01:51.342434 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 62/111] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:50 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:01:51.355572 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-759b2f1f-2176-47b1-be47-dcf01546a1bc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:51.357251 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-759b2f1f-2176-47b1-be47-dcf01546a1bc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:51.375719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-759b2f1f-2176-47b1-be47-dcf01546a1bc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:51.378343 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-759b2f1f-2176-47b1-be47-dcf01546a1bc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:51.379281 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-759b2f1f-2176-47b1-be47-dcf01546a1bc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:51.382829 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-759b2f1f-2176-47b1-be47-dcf01546a1bc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:51.400307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-759b2f1f-2176-47b1-be47-dcf01546a1bc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:51.400956 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-759b2f1f-2176-47b1-be47-dcf01546a1bc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:51.616095 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ef2f17a7-5963-4720-a47f-cc60442f239c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:51.628782 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ef2f17a7-5963-4720-a47f-cc60442f239c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1322 microversion: 2.1 time: 0.484346 Sep 13 07:01:51.629554 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 50/112] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:51 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1322 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:51.640239 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-06a35ac3-ea4b-44a0-97c6-f9474d543ddc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:51.640796 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-06a35ac3-ea4b-44a0-97c6-f9474d543ddc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:51.655859 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-06a35ac3-ea4b-44a0-97c6-f9474d543ddc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:51.658675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-06a35ac3-ea4b-44a0-97c6-f9474d543ddc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:51.659278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-06a35ac3-ea4b-44a0-97c6-f9474d543ddc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:51.660636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-06a35ac3-ea4b-44a0-97c6-f9474d543ddc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:51.661248 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-06a35ac3-ea4b-44a0-97c6-f9474d543ddc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:51.662327 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-06a35ac3-ea4b-44a0-97c6-f9474d543ddc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:51.804800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-759b2f1f-2176-47b1-be47-dcf01546a1bc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:51.813863 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-759b2f1f-2176-47b1-be47-dcf01546a1bc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:51.815775 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-759b2f1f-2176-47b1-be47-dcf01546a1bc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:51.817166 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-759b2f1f-2176-47b1-be47-dcf01546a1bc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1406 microversion: 2.20 time: 0.472534 Sep 13 07:01:51.831110 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 63/113] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:01:51 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1406 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:01:51.921625 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-06a35ac3-ea4b-44a0-97c6-f9474d543ddc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:51.930407 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-06a35ac3-ea4b-44a0-97c6-f9474d543ddc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1556 microversion: 2.1 time: 0.298142 Sep 13 07:01:51.931344 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 51/114] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:51 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1556 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:51.954423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6cb9ea4c-d3b1-48c4-8025-b924d187185b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:51.954910 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6cb9ea4c-d3b1-48c4-8025-b924d187185b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:51.962156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6cb9ea4c-d3b1-48c4-8025-b924d187185b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:51.962867 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6cb9ea4c-d3b1-48c4-8025-b924d187185b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:51.963619 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6cb9ea4c-d3b1-48c4-8025-b924d187185b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:51.964497 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6cb9ea4c-d3b1-48c4-8025-b924d187185b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:51.965099 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6cb9ea4c-d3b1-48c4-8025-b924d187185b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:51.965681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6cb9ea4c-d3b1-48c4-8025-b924d187185b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:52.113556 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6cb9ea4c-d3b1-48c4-8025-b924d187185b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.162979 Sep 13 07:01:52.114990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 64/115] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Sep 13 07:01:51 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:01:52.364760 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-84a29194-c173-4e18-abe3-6fe86723e171 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:52.365430 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-84a29194-c173-4e18-abe3-6fe86723e171 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:52.374629 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84a29194-c173-4e18-abe3-6fe86723e171 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:52.375672 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84a29194-c173-4e18-abe3-6fe86723e171 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:52.377958 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84a29194-c173-4e18-abe3-6fe86723e171 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:52.379849 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84a29194-c173-4e18-abe3-6fe86723e171 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:52.380882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84a29194-c173-4e18-abe3-6fe86723e171 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:52.382370 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84a29194-c173-4e18-abe3-6fe86723e171 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:52.653790 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b0cb330f-00c2-4bc5-b837-d88fb61ec4dc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:52.654811 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b0cb330f-00c2-4bc5-b837-d88fb61ec4dc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:52.664128 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0cb330f-00c2-4bc5-b837-d88fb61ec4dc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:52.666314 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0cb330f-00c2-4bc5-b837-d88fb61ec4dc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:52.666777 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0cb330f-00c2-4bc5-b837-d88fb61ec4dc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:52.670292 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0cb330f-00c2-4bc5-b837-d88fb61ec4dc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:52.670823 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0cb330f-00c2-4bc5-b837-d88fb61ec4dc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:52.672960 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0cb330f-00c2-4bc5-b837-d88fb61ec4dc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:52.727858 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-84a29194-c173-4e18-abe3-6fe86723e171 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:52.737341 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-84a29194-c173-4e18-abe3-6fe86723e171 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1315 microversion: 2.1 time: 0.376535 Sep 13 07:01:52.741923 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 52/116] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:52 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:52.867381 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-879fbaf6-f4b4-453b-beca-70ee2352a6dd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:52.868025 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-879fbaf6-f4b4-453b-beca-70ee2352a6dd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:52.881695 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-879fbaf6-f4b4-453b-beca-70ee2352a6dd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:52.882226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-879fbaf6-f4b4-453b-beca-70ee2352a6dd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:52.882798 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-879fbaf6-f4b4-453b-beca-70ee2352a6dd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:52.883518 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-879fbaf6-f4b4-453b-beca-70ee2352a6dd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:52.883968 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-879fbaf6-f4b4-453b-beca-70ee2352a6dd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:52.884388 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-879fbaf6-f4b4-453b-beca-70ee2352a6dd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:53.194555 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b0cb330f-00c2-4bc5-b837-d88fb61ec4dc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:53.204374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b0cb330f-00c2-4bc5-b837-d88fb61ec4dc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1322 microversion: 2.1 time: 0.554545 Sep 13 07:01:53.219376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 65/117] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:52 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1322 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:01:53.228120 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b160116b-75fc-42f7-89ce-29390a215c85 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1859856154", "imageRef": "19a6700e-e153-4bea-87aa-036bfccf0ecd", "flavorRef": "452", "networks": [{"uuid": "f93137cd-66b0-4f09-930d-e6072707a728"}]}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:01:53.298946 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-b160116b-75fc-42f7-89ce-29390a215c85 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] validate_networks() for [('f93137cd-66b0-4f09-930d-e6072707a728', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:01:53.506169 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-879fbaf6-f4b4-453b-beca-70ee2352a6dd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:53.522050 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-879fbaf6-f4b4-453b-beca-70ee2352a6dd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:53.526566 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-879fbaf6-f4b4-453b-beca-70ee2352a6dd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:53.527753 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-879fbaf6-f4b4-453b-beca-70ee2352a6dd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1406 microversion: 2.20 time: 0.668454 Sep 13 07:01:53.530981 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 53/118] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:01:52 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1406 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:01:53.764824 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3a0aac11-c6dc-4c11-9467-d212e0fecc5c tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:53.765620 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3a0aac11-c6dc-4c11-9467-d212e0fecc5c tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:53.771899 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a0aac11-c6dc-4c11-9467-d212e0fecc5c tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:53.772574 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a0aac11-c6dc-4c11-9467-d212e0fecc5c tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:53.773176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a0aac11-c6dc-4c11-9467-d212e0fecc5c tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:53.774009 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a0aac11-c6dc-4c11-9467-d212e0fecc5c tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:53.774619 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a0aac11-c6dc-4c11-9467-d212e0fecc5c tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:53.775176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a0aac11-c6dc-4c11-9467-d212e0fecc5c tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:54.123452 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3a0aac11-c6dc-4c11-9467-d212e0fecc5c tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:54.134797 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3a0aac11-c6dc-4c11-9467-d212e0fecc5c tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1502 microversion: 2.1 time: 0.373698 Sep 13 07:01:54.135382 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 54/119] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:53 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1502 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:54.230900 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-881ed098-9cd0-491c-90c2-29c3232d95fe tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:54.231675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-881ed098-9cd0-491c-90c2-29c3232d95fe tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:54.239126 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-881ed098-9cd0-491c-90c2-29c3232d95fe tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:54.243698 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-881ed098-9cd0-491c-90c2-29c3232d95fe tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:54.244330 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-881ed098-9cd0-491c-90c2-29c3232d95fe tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:54.245544 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-881ed098-9cd0-491c-90c2-29c3232d95fe tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:54.246568 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-881ed098-9cd0-491c-90c2-29c3232d95fe tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:54.248102 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-881ed098-9cd0-491c-90c2-29c3232d95fe tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:54.529331 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-b160116b-75fc-42f7-89ce-29390a215c85 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:01:54.529928 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-b160116b-75fc-42f7-89ce-29390a215c85 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:01:54.530433 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-b160116b-75fc-42f7-89ce-29390a215c85 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:01:54.530984 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-b160116b-75fc-42f7-89ce-29390a215c85 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:01:54.531510 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-b160116b-75fc-42f7-89ce-29390a215c85 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:01:54.548571 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b160116b-75fc-42f7-89ce-29390a215c85 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:54.549171 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b160116b-75fc-42f7-89ce-29390a215c85 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:54.549625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b160116b-75fc-42f7-89ce-29390a215c85 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:54.550640 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b160116b-75fc-42f7-89ce-29390a215c85 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:54.551118 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b160116b-75fc-42f7-89ce-29390a215c85 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:54.551554 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b160116b-75fc-42f7-89ce-29390a215c85 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:54.600992 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-881ed098-9cd0-491c-90c2-29c3232d95fe tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:54.614227 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-b160116b-75fc-42f7-89ce-29390a215c85 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Getting quotas for project 81082b2f3a984d09baac046de385ea96. Resources: {'instances', 'cores', 'ram'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:01:54.618673 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-881ed098-9cd0-491c-90c2-29c3232d95fe tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1512 microversion: 2.1 time: 0.391276 Sep 13 07:01:54.622979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 55/120] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:54 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1512 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:01:54.634628 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-889d047e-cd4e-47db-835d-00c2b3c00949 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:54.636569 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-b160116b-75fc-42f7-89ce-29390a215c85 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Getting quotas for user 5bd897d855c64ae28ec3f10f69e9e8b2 and project 81082b2f3a984d09baac046de385ea96. Resources: {'instances', 'cores', 'ram'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:01:54.650937 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-889d047e-cd4e-47db-835d-00c2b3c00949 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:54.667711 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b160116b-75fc-42f7-89ce-29390a215c85 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:01:54.671652 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b160116b-75fc-42f7-89ce-29390a215c85 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='19a6700e-e153-4bea-87aa-036bfccf0ecd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:01:54.689046 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-889d047e-cd4e-47db-835d-00c2b3c00949 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:54.689823 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-889d047e-cd4e-47db-835d-00c2b3c00949 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:54.690486 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-889d047e-cd4e-47db-835d-00c2b3c00949 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:54.691919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-889d047e-cd4e-47db-835d-00c2b3c00949 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:54.692695 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-889d047e-cd4e-47db-835d-00c2b3c00949 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:54.693316 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-889d047e-cd4e-47db-835d-00c2b3c00949 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:54.809594 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b160116b-75fc-42f7-89ce-29390a215c85 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.589120 Sep 13 07:01:54.816544 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 66/121] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Sep 13 07:01:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 07:01:54.824642 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-db81589a-f1c9-478c-bf29-581e73a16076 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:01:54.826921 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-db81589a-f1c9-478c-bf29-581e73a16076 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:54.851017 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-db81589a-f1c9-478c-bf29-581e73a16076 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:54.851017 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-db81589a-f1c9-478c-bf29-581e73a16076 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:54.851347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-db81589a-f1c9-478c-bf29-581e73a16076 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:54.852051 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-db81589a-f1c9-478c-bf29-581e73a16076 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:54.852470 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-db81589a-f1c9-478c-bf29-581e73a16076 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:54.852881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-db81589a-f1c9-478c-bf29-581e73a16076 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:54.906786 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-db81589a-f1c9-478c-bf29-581e73a16076 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lazy-loading 'flavor' on Instance uuid 49b2d57b-6193-4a49-9ff3-334ada85b470 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:01:55.064851 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-889d047e-cd4e-47db-835d-00c2b3c00949 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:55.079817 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-889d047e-cd4e-47db-835d-00c2b3c00949 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:55.084790 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-889d047e-cd4e-47db-835d-00c2b3c00949 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:55.088596 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-889d047e-cd4e-47db-835d-00c2b3c00949 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1598 microversion: 2.20 time: 0.462214 Sep 13 07:01:55.090408 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 56/122] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:01:54 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1598 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:01:55.103251 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7c060e25-1d8e-4ac4-a44b-65dcde6f4229 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:55.104320 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7c060e25-1d8e-4ac4-a44b-65dcde6f4229 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:55.144473 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-db81589a-f1c9-478c-bf29-581e73a16076 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "POST /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470/action" status: 200 len: 32 microversion: 2.1 time: 0.325883 Sep 13 07:01:55.146840 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 67/123] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Sep 13 07:01:54 2022] POST /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470/action => generated 32 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 07:01:55.154283 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-071540e3-ee76-4bcb-b64c-a42f88eb1988 req-4b3ac29c-50da-4ef8-9377-46b4e49cfed3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98fc8f3f-7357-45fd-b982-ea283b3b33dd", "tag": "ef18f87e-b4ae-437d-90c7-0368d0e8dc10"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:01:55.175904 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7c060e25-1d8e-4ac4-a44b-65dcde6f4229 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:55.184588 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7c060e25-1d8e-4ac4-a44b-65dcde6f4229 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1214 microversion: 2.1 time: 0.092883 Sep 13 07:01:55.185189 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 57/124] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:55 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:55.191141 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9db287eb-92e0-4371-990e-272eeae0ca8c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:55.191843 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9db287eb-92e0-4371-990e-272eeae0ca8c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:55.199407 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9db287eb-92e0-4371-990e-272eeae0ca8c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:55.200549 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9db287eb-92e0-4371-990e-272eeae0ca8c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:55.201290 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9db287eb-92e0-4371-990e-272eeae0ca8c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:55.202413 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9db287eb-92e0-4371-990e-272eeae0ca8c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:55.203051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9db287eb-92e0-4371-990e-272eeae0ca8c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:55.203647 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9db287eb-92e0-4371-990e-272eeae0ca8c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:55.216426 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-071540e3-ee76-4bcb-b64c-a42f88eb1988 req-4b3ac29c-50da-4ef8-9377-46b4e49cfed3 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:55.218375 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-071540e3-ee76-4bcb-b64c-a42f88eb1988 req-4b3ac29c-50da-4ef8-9377-46b4e49cfed3 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:55.219234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-071540e3-ee76-4bcb-b64c-a42f88eb1988 req-4b3ac29c-50da-4ef8-9377-46b4e49cfed3 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:55.261639 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-071540e3-ee76-4bcb-b64c-a42f88eb1988 req-4b3ac29c-50da-4ef8-9377-46b4e49cfed3 service nova] Creating event network-changed:ef18f87e-b4ae-437d-90c7-0368d0e8dc10 for instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd on hv-cinder-85694 Sep 13 07:01:55.270948 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-071540e3-ee76-4bcb-b64c-a42f88eb1988 req-4b3ac29c-50da-4ef8-9377-46b4e49cfed3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122570 Sep 13 07:01:55.274186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 68/125] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:01:55.290931 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-70ee22fd-6016-48a2-849d-1f522951ccae tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:55.292627 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-70ee22fd-6016-48a2-849d-1f522951ccae tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:55.312374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-70ee22fd-6016-48a2-849d-1f522951ccae tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:55.313211 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-70ee22fd-6016-48a2-849d-1f522951ccae tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:55.313828 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-70ee22fd-6016-48a2-849d-1f522951ccae tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:55.314752 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-70ee22fd-6016-48a2-849d-1f522951ccae tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:55.315378 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-70ee22fd-6016-48a2-849d-1f522951ccae tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:55.315943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-70ee22fd-6016-48a2-849d-1f522951ccae tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:55.527154 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9db287eb-92e0-4371-990e-272eeae0ca8c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.340783 Sep 13 07:01:55.528108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 58/126] 10.222.0.25 () {60 vars in 1316 bytes} [Tue Sep 13 07:01:55 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad/os-interface => generated 284 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:01:55.881515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-76c3d856-9057-431b-8f93-e96f60b844df tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "547efa13-6185-4f6e-8f4c-a1f8e0dcbd02"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:01:55.884015 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-76c3d856-9057-431b-8f93-e96f60b844df tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:55.893717 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-76c3d856-9057-431b-8f93-e96f60b844df tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:55.898466 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-76c3d856-9057-431b-8f93-e96f60b844df tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:55.898847 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-76c3d856-9057-431b-8f93-e96f60b844df tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:55.899600 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-76c3d856-9057-431b-8f93-e96f60b844df tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:55.900230 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-76c3d856-9057-431b-8f93-e96f60b844df tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:55.900663 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-76c3d856-9057-431b-8f93-e96f60b844df tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:55.997736 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-70ee22fd-6016-48a2-849d-1f522951ccae tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:56.011616 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-70ee22fd-6016-48a2-849d-1f522951ccae tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.720745 Sep 13 07:01:56.012457 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 69/127] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:55 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:56.218820 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-00d9694f-a4f2-4c40-a3aa-2b0bba42e0aa tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:56.219791 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-00d9694f-a4f2-4c40-a3aa-2b0bba42e0aa tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:56.242710 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00d9694f-a4f2-4c40-a3aa-2b0bba42e0aa tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:56.243621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00d9694f-a4f2-4c40-a3aa-2b0bba42e0aa tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:56.244257 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00d9694f-a4f2-4c40-a3aa-2b0bba42e0aa tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:56.245207 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00d9694f-a4f2-4c40-a3aa-2b0bba42e0aa tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:56.245862 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00d9694f-a4f2-4c40-a3aa-2b0bba42e0aa tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:56.246517 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00d9694f-a4f2-4c40-a3aa-2b0bba42e0aa tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:56.633015 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:56.661751 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-76c3d856-9057-431b-8f93-e96f60b844df tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "POST /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.782694 Sep 13 07:01:56.662872 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 59/128] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Sep 13 07:01:55 2022] POST /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de/os-volume_attachments => generated 194 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:01:56.856706 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-00d9694f-a4f2-4c40-a3aa-2b0bba42e0aa tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:56.894785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-00d9694f-a4f2-4c40-a3aa-2b0bba42e0aa tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1210 microversion: 2.1 time: 0.677762 Sep 13 07:01:56.896590 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 70/129] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:56 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1210 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:01:57.039634 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e798bf82-2077-41ba-9bbe-130adc737778 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:57.041127 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e798bf82-2077-41ba-9bbe-130adc737778 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:57.054543 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e798bf82-2077-41ba-9bbe-130adc737778 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:57.055320 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e798bf82-2077-41ba-9bbe-130adc737778 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:57.056341 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e798bf82-2077-41ba-9bbe-130adc737778 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:57.057348 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e798bf82-2077-41ba-9bbe-130adc737778 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:57.057956 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e798bf82-2077-41ba-9bbe-130adc737778 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:57.059044 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e798bf82-2077-41ba-9bbe-130adc737778 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:57.360847 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e798bf82-2077-41ba-9bbe-130adc737778 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:57.384794 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e798bf82-2077-41ba-9bbe-130adc737778 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.351325 Sep 13 07:01:57.400185 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 60/130] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:57 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:57.929937 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-68c2a4bb-b228-4ca1-a1fb-e3482620d330 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:57.932946 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-68c2a4bb-b228-4ca1-a1fb-e3482620d330 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:57.940683 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68c2a4bb-b228-4ca1-a1fb-e3482620d330 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:57.941489 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68c2a4bb-b228-4ca1-a1fb-e3482620d330 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:57.942224 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68c2a4bb-b228-4ca1-a1fb-e3482620d330 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:57.943346 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68c2a4bb-b228-4ca1-a1fb-e3482620d330 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:57.944016 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68c2a4bb-b228-4ca1-a1fb-e3482620d330 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:57.944694 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68c2a4bb-b228-4ca1-a1fb-e3482620d330 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:58.089307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-68c2a4bb-b228-4ca1-a1fb-e3482620d330 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:58.124265 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-68c2a4bb-b228-4ca1-a1fb-e3482620d330 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1272 microversion: 2.1 time: 0.202103 Sep 13 07:01:58.131578 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 71/131] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:57 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1272 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:58.407717 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b2e4ca5a-8a43-4615-9db9-91312934b08f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:58.408954 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b2e4ca5a-8a43-4615-9db9-91312934b08f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:58.412913 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=86 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:58.436979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2e4ca5a-8a43-4615-9db9-91312934b08f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:58.437523 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2e4ca5a-8a43-4615-9db9-91312934b08f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:58.437964 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2e4ca5a-8a43-4615-9db9-91312934b08f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:58.438726 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2e4ca5a-8a43-4615-9db9-91312934b08f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:58.439179 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2e4ca5a-8a43-4615-9db9-91312934b08f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:58.446791 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-e8efc242-4051-4e4d-a27d-2058eff24132 req-f6889816-d9e8-46ce-b901-530be6777807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d57882a-892f-4b45-a8ec-7b6f4b21b0ad", "tag": "447e368f-71d6-49ce-be81-226ee22458f1"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:01:58.455214 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2e4ca5a-8a43-4615-9db9-91312934b08f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:58.459915 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:58.469038 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e8efc242-4051-4e4d-a27d-2058eff24132 req-f6889816-d9e8-46ce-b901-530be6777807 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:58.469569 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e8efc242-4051-4e4d-a27d-2058eff24132 req-f6889816-d9e8-46ce-b901-530be6777807 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:58.469954 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e8efc242-4051-4e4d-a27d-2058eff24132 req-f6889816-d9e8-46ce-b901-530be6777807 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:58.502398 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-e8efc242-4051-4e4d-a27d-2058eff24132 req-f6889816-d9e8-46ce-b901-530be6777807 service nova] Creating event network-changed:447e368f-71d6-49ce-be81-226ee22458f1 for instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad on hv-cinder-85694 Sep 13 07:01:58.534139 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-e8efc242-4051-4e4d-a27d-2058eff24132 req-f6889816-d9e8-46ce-b901-530be6777807 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092361 Sep 13 07:01:58.534718 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 72/132] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:01:58.948135 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b2e4ca5a-8a43-4615-9db9-91312934b08f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:58.961128 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b2e4ca5a-8a43-4615-9db9-91312934b08f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.553892 Sep 13 07:01:58.961827 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 61/133] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:58 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:59.163067 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c3ec4347-7764-4144-9103-97686907c5b6 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:59.166417 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c3ec4347-7764-4144-9103-97686907c5b6 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:01:59.176465 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c3ec4347-7764-4144-9103-97686907c5b6 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:59.177258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c3ec4347-7764-4144-9103-97686907c5b6 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:59.178685 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c3ec4347-7764-4144-9103-97686907c5b6 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:59.179620 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c3ec4347-7764-4144-9103-97686907c5b6 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:01:59.180518 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c3ec4347-7764-4144-9103-97686907c5b6 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:01:59.181287 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c3ec4347-7764-4144-9103-97686907c5b6 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:01:59.510662 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c3ec4347-7764-4144-9103-97686907c5b6 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:01:59.522711 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c3ec4347-7764-4144-9103-97686907c5b6 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1314 microversion: 2.1 time: 0.367642 Sep 13 07:01:59.525271 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 73/134] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:59 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:01:59.989367 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a46c9b53-fc7d-4780-a154-f5335d8fe411 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:01:59.990923 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a46c9b53-fc7d-4780-a154-f5335d8fe411 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:00.000170 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a46c9b53-fc7d-4780-a154-f5335d8fe411 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:00.001110 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a46c9b53-fc7d-4780-a154-f5335d8fe411 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:00.001750 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a46c9b53-fc7d-4780-a154-f5335d8fe411 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:00.002698 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a46c9b53-fc7d-4780-a154-f5335d8fe411 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:00.004081 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a46c9b53-fc7d-4780-a154-f5335d8fe411 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:00.004829 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a46c9b53-fc7d-4780-a154-f5335d8fe411 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:00.101249 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-0b594a82-1cfb-4ec3-b07c-6a71970ccd6f req-c33112bf-39e9-4167-9b2c-cc7d4023c227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa", "tag": "d54180b0-de96-4099-b8c9-e23302999315"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:02:00.116074 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0b594a82-1cfb-4ec3-b07c-6a71970ccd6f req-c33112bf-39e9-4167-9b2c-cc7d4023c227 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:00.116566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0b594a82-1cfb-4ec3-b07c-6a71970ccd6f req-c33112bf-39e9-4167-9b2c-cc7d4023c227 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:00.116994 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0b594a82-1cfb-4ec3-b07c-6a71970ccd6f req-c33112bf-39e9-4167-9b2c-cc7d4023c227 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:00.152372 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-0b594a82-1cfb-4ec3-b07c-6a71970ccd6f req-c33112bf-39e9-4167-9b2c-cc7d4023c227 service nova] Creating event network-changed:d54180b0-de96-4099-b8c9-e23302999315 for instance 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa on hv-cinder-85694 Sep 13 07:02:00.157432 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-0b594a82-1cfb-4ec3-b07c-6a71970ccd6f req-c33112bf-39e9-4167-9b2c-cc7d4023c227 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060232 Sep 13 07:02:00.158594 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 74/135] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:02:00.231777 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a46c9b53-fc7d-4780-a154-f5335d8fe411 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:00.241693 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a46c9b53-fc7d-4780-a154-f5335d8fe411 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.259308 Sep 13 07:02:00.242315 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 62/136] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:01:59 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:02:00.549869 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3d9a2629-99df-4a0d-aef7-203a225f1ca8 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:00.550717 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3d9a2629-99df-4a0d-aef7-203a225f1ca8 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:00.564478 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d9a2629-99df-4a0d-aef7-203a225f1ca8 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:00.565221 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d9a2629-99df-4a0d-aef7-203a225f1ca8 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:00.565640 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d9a2629-99df-4a0d-aef7-203a225f1ca8 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:00.566433 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d9a2629-99df-4a0d-aef7-203a225f1ca8 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:00.567069 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d9a2629-99df-4a0d-aef7-203a225f1ca8 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:00.568182 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d9a2629-99df-4a0d-aef7-203a225f1ca8 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:00.717704 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3d9a2629-99df-4a0d-aef7-203a225f1ca8 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:00.726115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3d9a2629-99df-4a0d-aef7-203a225f1ca8 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1314 microversion: 2.1 time: 0.180466 Sep 13 07:02:00.726703 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 75/137] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:00 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:02:01.271361 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-23da9804-4349-4c42-81dd-6ff0b122c028 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:01.271997 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-23da9804-4349-4c42-81dd-6ff0b122c028 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:01.279106 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23da9804-4349-4c42-81dd-6ff0b122c028 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:01.279572 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23da9804-4349-4c42-81dd-6ff0b122c028 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:01.280019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23da9804-4349-4c42-81dd-6ff0b122c028 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:01.280713 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23da9804-4349-4c42-81dd-6ff0b122c028 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:01.281173 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23da9804-4349-4c42-81dd-6ff0b122c028 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:01.281566 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23da9804-4349-4c42-81dd-6ff0b122c028 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:01.425600 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-23da9804-4349-4c42-81dd-6ff0b122c028 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:01.434575 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-23da9804-4349-4c42-81dd-6ff0b122c028 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.167732 Sep 13 07:02:01.435197 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 63/138] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:01 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:01.751124 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ac616fe8-bbec-4da1-bd37-87aa831f6ea5 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:01.752209 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ac616fe8-bbec-4da1-bd37-87aa831f6ea5 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:01.758994 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ac616fe8-bbec-4da1-bd37-87aa831f6ea5 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:01.759622 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ac616fe8-bbec-4da1-bd37-87aa831f6ea5 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:01.760403 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ac616fe8-bbec-4da1-bd37-87aa831f6ea5 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:01.761323 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ac616fe8-bbec-4da1-bd37-87aa831f6ea5 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:01.761787 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ac616fe8-bbec-4da1-bd37-87aa831f6ea5 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:01.762410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ac616fe8-bbec-4da1-bd37-87aa831f6ea5 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:01.915625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ac616fe8-bbec-4da1-bd37-87aa831f6ea5 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:01.920534 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:01.927100 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ac616fe8-bbec-4da1-bd37-87aa831f6ea5 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1314 microversion: 2.1 time: 0.179615 Sep 13 07:02:01.928378 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 76/139] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:01 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:02.457917 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-245de4f8-d180-4916-9446-739c50cf4132 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:02.458790 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-245de4f8-d180-4916-9446-739c50cf4132 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:02.465529 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-245de4f8-d180-4916-9446-739c50cf4132 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:02.466104 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-245de4f8-d180-4916-9446-739c50cf4132 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:02.466610 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-245de4f8-d180-4916-9446-739c50cf4132 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:02.467371 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-245de4f8-d180-4916-9446-739c50cf4132 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:02.467891 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-245de4f8-d180-4916-9446-739c50cf4132 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:02.468393 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-245de4f8-d180-4916-9446-739c50cf4132 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:02.605276 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-245de4f8-d180-4916-9446-739c50cf4132 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:02.613587 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-245de4f8-d180-4916-9446-739c50cf4132 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.159398 Sep 13 07:02:02.614431 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 64/140] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:02 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:02.952892 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fff5609d-eac7-4af2-a9c0-1948de6c8279 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:02.953718 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fff5609d-eac7-4af2-a9c0-1948de6c8279 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:02.963917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fff5609d-eac7-4af2-a9c0-1948de6c8279 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:02.964407 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fff5609d-eac7-4af2-a9c0-1948de6c8279 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:02.964840 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fff5609d-eac7-4af2-a9c0-1948de6c8279 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:02.966055 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fff5609d-eac7-4af2-a9c0-1948de6c8279 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:02.966880 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fff5609d-eac7-4af2-a9c0-1948de6c8279 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:02.967474 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fff5609d-eac7-4af2-a9c0-1948de6c8279 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:03.112450 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fff5609d-eac7-4af2-a9c0-1948de6c8279 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:03.122042 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fff5609d-eac7-4af2-a9c0-1948de6c8279 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1314 microversion: 2.1 time: 0.173918 Sep 13 07:02:03.123007 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 77/141] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:02 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:03.642069 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a05f4ee0-18e1-4034-b7af-bbe063ac9a2d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:03.643418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a05f4ee0-18e1-4034-b7af-bbe063ac9a2d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:03.657372 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a05f4ee0-18e1-4034-b7af-bbe063ac9a2d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:03.658254 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a05f4ee0-18e1-4034-b7af-bbe063ac9a2d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:03.659217 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a05f4ee0-18e1-4034-b7af-bbe063ac9a2d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:03.660535 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a05f4ee0-18e1-4034-b7af-bbe063ac9a2d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:03.662008 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a05f4ee0-18e1-4034-b7af-bbe063ac9a2d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:03.663022 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a05f4ee0-18e1-4034-b7af-bbe063ac9a2d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:03.881697 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a05f4ee0-18e1-4034-b7af-bbe063ac9a2d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:03.893132 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a05f4ee0-18e1-4034-b7af-bbe063ac9a2d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.259623 Sep 13 07:02:03.894175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 65/142] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:03 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:04.146069 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-da47e7ae-e80a-4bdd-8d94-bcb332fd5c8d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:04.147488 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-da47e7ae-e80a-4bdd-8d94-bcb332fd5c8d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:04.154665 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-da47e7ae-e80a-4bdd-8d94-bcb332fd5c8d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:04.155146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-da47e7ae-e80a-4bdd-8d94-bcb332fd5c8d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:04.155759 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-da47e7ae-e80a-4bdd-8d94-bcb332fd5c8d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:04.156820 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-da47e7ae-e80a-4bdd-8d94-bcb332fd5c8d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:04.157276 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-da47e7ae-e80a-4bdd-8d94-bcb332fd5c8d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:04.158030 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-da47e7ae-e80a-4bdd-8d94-bcb332fd5c8d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:04.319700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-da47e7ae-e80a-4bdd-8d94-bcb332fd5c8d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:04.328799 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-da47e7ae-e80a-4bdd-8d94-bcb332fd5c8d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1314 microversion: 2.1 time: 0.187802 Sep 13 07:02:04.329373 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 78/143] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:04 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:04.916693 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e361301c-61c8-4c23-980b-3df2482909ef tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:04.917863 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e361301c-61c8-4c23-980b-3df2482909ef tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:04.924853 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e361301c-61c8-4c23-980b-3df2482909ef tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:04.925346 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e361301c-61c8-4c23-980b-3df2482909ef tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:04.925776 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e361301c-61c8-4c23-980b-3df2482909ef tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:04.926890 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e361301c-61c8-4c23-980b-3df2482909ef tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:04.927322 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e361301c-61c8-4c23-980b-3df2482909ef tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:04.927716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e361301c-61c8-4c23-980b-3df2482909ef tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:05.180505 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:05.225169 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e361301c-61c8-4c23-980b-3df2482909ef tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:05.235367 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e361301c-61c8-4c23-980b-3df2482909ef tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.323020 Sep 13 07:02:05.242593 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 66/144] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:04 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:05.358258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5b0f9d27-66c5-4ab8-8a23-1f447baf9688 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:05.360572 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5b0f9d27-66c5-4ab8-8a23-1f447baf9688 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:05.363162 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:05.380265 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=6 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:05.395372 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5b0f9d27-66c5-4ab8-8a23-1f447baf9688 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:05.396184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5b0f9d27-66c5-4ab8-8a23-1f447baf9688 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:05.396819 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5b0f9d27-66c5-4ab8-8a23-1f447baf9688 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:05.399170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5b0f9d27-66c5-4ab8-8a23-1f447baf9688 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:05.401414 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5b0f9d27-66c5-4ab8-8a23-1f447baf9688 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:05.402225 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5b0f9d27-66c5-4ab8-8a23-1f447baf9688 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:05.647983 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5b0f9d27-66c5-4ab8-8a23-1f447baf9688 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:05.655666 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5b0f9d27-66c5-4ab8-8a23-1f447baf9688 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1314 microversion: 2.1 time: 0.302701 Sep 13 07:02:05.664203 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 79/145] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:05 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:05.900320 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-d759a967-b011-46de-9bdf-ce619345fdf2 req-9428cead-3e0b-442a-ad0e-987a443f14ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa", "name": "network-vif-plugged", "status": "completed", "tag": "d54180b0-de96-4099-b8c9-e23302999315"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:02:05.911736 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-d759a967-b011-46de-9bdf-ce619345fdf2 req-9428cead-3e0b-442a-ad0e-987a443f14ad service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:05.912536 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-d759a967-b011-46de-9bdf-ce619345fdf2 req-9428cead-3e0b-442a-ad0e-987a443f14ad service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:05.913429 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-d759a967-b011-46de-9bdf-ce619345fdf2 req-9428cead-3e0b-442a-ad0e-987a443f14ad service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:05.927753 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-d759a967-b011-46de-9bdf-ce619345fdf2 req-9428cead-3e0b-442a-ad0e-987a443f14ad service nova] Creating event network-vif-plugged:d54180b0-de96-4099-b8c9-e23302999315 for instance 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa on hv-cinder-85694 Sep 13 07:02:05.934523 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-d759a967-b011-46de-9bdf-ce619345fdf2 req-9428cead-3e0b-442a-ad0e-987a443f14ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037871 Sep 13 07:02:05.935388 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 67/146] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:02:06.086738 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-83215c71-5d8a-41c0-969b-1c12abdc7a05 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:06.087323 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-83215c71-5d8a-41c0-969b-1c12abdc7a05 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:06.094394 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83215c71-5d8a-41c0-969b-1c12abdc7a05 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:06.095426 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83215c71-5d8a-41c0-969b-1c12abdc7a05 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:06.096192 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83215c71-5d8a-41c0-969b-1c12abdc7a05 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:06.097131 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83215c71-5d8a-41c0-969b-1c12abdc7a05 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:06.097652 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83215c71-5d8a-41c0-969b-1c12abdc7a05 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:06.098467 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83215c71-5d8a-41c0-969b-1c12abdc7a05 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:06.128865 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-83215c71-5d8a-41c0-969b-1c12abdc7a05 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:02:06.243942 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-83215c71-5d8a-41c0-969b-1c12abdc7a05 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 204 len: 0 microversion: 2.1 time: 0.161886 Sep 13 07:02:06.244917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 80/147] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:02:06 2022] DELETE /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:02:06.255652 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-82e7f1ea-b0bf-4d57-b35b-5b324d935821 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:06.256549 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-82e7f1ea-b0bf-4d57-b35b-5b324d935821 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:06.259640 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-120118a3-00d2-4ef8-8693-4d1ec4580aa2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:06.260417 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-120118a3-00d2-4ef8-8693-4d1ec4580aa2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:06.268345 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-120118a3-00d2-4ef8-8693-4d1ec4580aa2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:06.269796 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-120118a3-00d2-4ef8-8693-4d1ec4580aa2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:06.271765 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-120118a3-00d2-4ef8-8693-4d1ec4580aa2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:06.272732 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-120118a3-00d2-4ef8-8693-4d1ec4580aa2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:06.273773 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-120118a3-00d2-4ef8-8693-4d1ec4580aa2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:06.273985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-120118a3-00d2-4ef8-8693-4d1ec4580aa2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:06.274315 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82e7f1ea-b0bf-4d57-b35b-5b324d935821 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:06.275038 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82e7f1ea-b0bf-4d57-b35b-5b324d935821 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:06.275607 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82e7f1ea-b0bf-4d57-b35b-5b324d935821 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:06.278190 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82e7f1ea-b0bf-4d57-b35b-5b324d935821 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:06.278793 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82e7f1ea-b0bf-4d57-b35b-5b324d935821 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:06.281031 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82e7f1ea-b0bf-4d57-b35b-5b324d935821 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:06.500067 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-120118a3-00d2-4ef8-8693-4d1ec4580aa2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:06.513095 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-120118a3-00d2-4ef8-8693-4d1ec4580aa2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.258267 Sep 13 07:02:06.513707 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 81/148] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:06 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:02:06.539048 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-82e7f1ea-b0bf-4d57-b35b-5b324d935821 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:06.552756 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-82e7f1ea-b0bf-4d57-b35b-5b324d935821 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1554 microversion: 2.1 time: 0.301716 Sep 13 07:02:06.554018 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 68/149] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:06 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1554 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:06.690475 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-14ff0546-2e11-436f-9f49-20a715a8312f tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:06.692802 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-14ff0546-2e11-436f-9f49-20a715a8312f tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:06.702901 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14ff0546-2e11-436f-9f49-20a715a8312f tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:06.703874 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14ff0546-2e11-436f-9f49-20a715a8312f tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:06.704376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14ff0546-2e11-436f-9f49-20a715a8312f tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:06.705217 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14ff0546-2e11-436f-9f49-20a715a8312f tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:06.705924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14ff0546-2e11-436f-9f49-20a715a8312f tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:06.706380 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14ff0546-2e11-436f-9f49-20a715a8312f tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:06.873005 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-14ff0546-2e11-436f-9f49-20a715a8312f tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:06.881205 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-14ff0546-2e11-436f-9f49-20a715a8312f tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1314 microversion: 2.1 time: 0.196187 Sep 13 07:02:06.881768 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 82/150] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:06 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:07.537139 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-250b8056-cc9a-4097-b0d6-c6cba0cff729 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:07.538424 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-250b8056-cc9a-4097-b0d6-c6cba0cff729 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:07.545838 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-250b8056-cc9a-4097-b0d6-c6cba0cff729 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:07.546489 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-250b8056-cc9a-4097-b0d6-c6cba0cff729 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:07.546928 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-250b8056-cc9a-4097-b0d6-c6cba0cff729 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:07.547742 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-250b8056-cc9a-4097-b0d6-c6cba0cff729 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:07.548306 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-250b8056-cc9a-4097-b0d6-c6cba0cff729 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:07.548869 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-250b8056-cc9a-4097-b0d6-c6cba0cff729 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:07.581666 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2d742dbb-3d5f-4e2b-8f80-dea8be9f313c tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:07.582409 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2d742dbb-3d5f-4e2b-8f80-dea8be9f313c tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:07.589569 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d742dbb-3d5f-4e2b-8f80-dea8be9f313c tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:07.590190 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d742dbb-3d5f-4e2b-8f80-dea8be9f313c tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:07.591458 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d742dbb-3d5f-4e2b-8f80-dea8be9f313c tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:07.592254 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d742dbb-3d5f-4e2b-8f80-dea8be9f313c tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:07.593152 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d742dbb-3d5f-4e2b-8f80-dea8be9f313c tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:07.593777 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d742dbb-3d5f-4e2b-8f80-dea8be9f313c tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:07.808594 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-250b8056-cc9a-4097-b0d6-c6cba0cff729 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:07.818720 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-250b8056-cc9a-4097-b0d6-c6cba0cff729 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.285805 Sep 13 07:02:07.819653 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 69/151] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:07 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:07.834312 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2d742dbb-3d5f-4e2b-8f80-dea8be9f313c tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:07.842002 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2d742dbb-3d5f-4e2b-8f80-dea8be9f313c tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1554 microversion: 2.1 time: 0.267037 Sep 13 07:02:07.857605 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 83/152] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:07 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1554 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:07.904568 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-28ac5dfe-40a8-47ca-a7a5-dd44b7ee2c09 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:07.905172 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-28ac5dfe-40a8-47ca-a7a5-dd44b7ee2c09 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:07.911433 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28ac5dfe-40a8-47ca-a7a5-dd44b7ee2c09 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:07.912246 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28ac5dfe-40a8-47ca-a7a5-dd44b7ee2c09 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:07.912741 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28ac5dfe-40a8-47ca-a7a5-dd44b7ee2c09 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:07.913513 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28ac5dfe-40a8-47ca-a7a5-dd44b7ee2c09 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:07.914031 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28ac5dfe-40a8-47ca-a7a5-dd44b7ee2c09 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:07.914599 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28ac5dfe-40a8-47ca-a7a5-dd44b7ee2c09 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:08.066369 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-28ac5dfe-40a8-47ca-a7a5-dd44b7ee2c09 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:08.076767 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-28ac5dfe-40a8-47ca-a7a5-dd44b7ee2c09 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1314 microversion: 2.1 time: 0.175862 Sep 13 07:02:08.077512 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 70/153] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:07 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:08.843566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6ab9f78f-dca5-4c57-bba9-ed769f74107c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:08.844112 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6ab9f78f-dca5-4c57-bba9-ed769f74107c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:08.850510 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ab9f78f-dca5-4c57-bba9-ed769f74107c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:08.850988 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ab9f78f-dca5-4c57-bba9-ed769f74107c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:08.851411 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ab9f78f-dca5-4c57-bba9-ed769f74107c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:08.852091 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ab9f78f-dca5-4c57-bba9-ed769f74107c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:08.852692 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ab9f78f-dca5-4c57-bba9-ed769f74107c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:08.853100 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ab9f78f-dca5-4c57-bba9-ed769f74107c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:08.864811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f4fbd62c-0aff-4433-bc9e-571f1a8966ec tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:08.866555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f4fbd62c-0aff-4433-bc9e-571f1a8966ec tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:08.871464 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f4fbd62c-0aff-4433-bc9e-571f1a8966ec tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:08.871940 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f4fbd62c-0aff-4433-bc9e-571f1a8966ec tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:08.872388 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f4fbd62c-0aff-4433-bc9e-571f1a8966ec tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:08.873047 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f4fbd62c-0aff-4433-bc9e-571f1a8966ec tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:08.873482 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f4fbd62c-0aff-4433-bc9e-571f1a8966ec tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:08.874055 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f4fbd62c-0aff-4433-bc9e-571f1a8966ec tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:09.060100 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6ab9f78f-dca5-4c57-bba9-ed769f74107c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:09.068992 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6ab9f78f-dca5-4c57-bba9-ed769f74107c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.229533 Sep 13 07:02:09.069888 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 84/154] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:08 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:09.087457 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f4fbd62c-0aff-4433-bc9e-571f1a8966ec tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:09.096784 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f4fbd62c-0aff-4433-bc9e-571f1a8966ec tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1554 microversion: 2.1 time: 0.235850 Sep 13 07:02:09.097511 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 71/155] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:08 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1554 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:02:09.099490 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d1c774f8-3a4c-4006-8771-37b76ec1fd8a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:09.100106 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d1c774f8-3a4c-4006-8771-37b76ec1fd8a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:09.106104 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d1c774f8-3a4c-4006-8771-37b76ec1fd8a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:09.106600 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d1c774f8-3a4c-4006-8771-37b76ec1fd8a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:09.107029 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d1c774f8-3a4c-4006-8771-37b76ec1fd8a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:09.107717 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d1c774f8-3a4c-4006-8771-37b76ec1fd8a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:09.108166 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d1c774f8-3a4c-4006-8771-37b76ec1fd8a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:09.108587 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d1c774f8-3a4c-4006-8771-37b76ec1fd8a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:09.250538 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d1c774f8-3a4c-4006-8771-37b76ec1fd8a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:09.258668 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d1c774f8-3a4c-4006-8771-37b76ec1fd8a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1314 microversion: 2.1 time: 0.163110 Sep 13 07:02:09.259238 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 85/156] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:09 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:10.093804 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0f1efa60-0ff5-49f0-a512-46fd848a77cf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:10.094973 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0f1efa60-0ff5-49f0-a512-46fd848a77cf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:10.101550 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f1efa60-0ff5-49f0-a512-46fd848a77cf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:10.102183 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f1efa60-0ff5-49f0-a512-46fd848a77cf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:10.102689 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f1efa60-0ff5-49f0-a512-46fd848a77cf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:10.103876 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f1efa60-0ff5-49f0-a512-46fd848a77cf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:10.104218 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f1efa60-0ff5-49f0-a512-46fd848a77cf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:10.104949 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f1efa60-0ff5-49f0-a512-46fd848a77cf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:10.120833 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-46d4da7c-4c83-433c-bd8b-5b233d14610f tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:10.122049 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-46d4da7c-4c83-433c-bd8b-5b233d14610f tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:10.128630 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46d4da7c-4c83-433c-bd8b-5b233d14610f tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:10.129349 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46d4da7c-4c83-433c-bd8b-5b233d14610f tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:10.130142 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46d4da7c-4c83-433c-bd8b-5b233d14610f tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:10.131037 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46d4da7c-4c83-433c-bd8b-5b233d14610f tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:10.131674 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46d4da7c-4c83-433c-bd8b-5b233d14610f tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:10.132301 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46d4da7c-4c83-433c-bd8b-5b233d14610f tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:10.339597 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0f1efa60-0ff5-49f0-a512-46fd848a77cf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:10.342582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-46d4da7c-4c83-433c-bd8b-5b233d14610f tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:10.348525 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0f1efa60-0ff5-49f0-a512-46fd848a77cf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.259919 Sep 13 07:02:10.349113 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 72/157] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:10 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:10.351283 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-46d4da7c-4c83-433c-bd8b-5b233d14610f tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1554 microversion: 2.1 time: 0.234927 Sep 13 07:02:10.353782 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c363f6c9-22dd-48c3-9575-dfc8472c6157 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:10.353976 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 86/158] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:10 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1554 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:10.354736 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c363f6c9-22dd-48c3-9575-dfc8472c6157 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:10.360759 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c363f6c9-22dd-48c3-9575-dfc8472c6157 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:10.361233 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c363f6c9-22dd-48c3-9575-dfc8472c6157 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:10.361653 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c363f6c9-22dd-48c3-9575-dfc8472c6157 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:10.362356 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c363f6c9-22dd-48c3-9575-dfc8472c6157 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:10.362982 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c363f6c9-22dd-48c3-9575-dfc8472c6157 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:10.363391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c363f6c9-22dd-48c3-9575-dfc8472c6157 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:10.503609 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c363f6c9-22dd-48c3-9575-dfc8472c6157 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:10.511672 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c363f6c9-22dd-48c3-9575-dfc8472c6157 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1314 microversion: 2.1 time: 0.161625 Sep 13 07:02:10.512246 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 73/159] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:10 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:11.375404 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-439044a1-72e3-4f77-8c69-6f0ca9c167c9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:11.376320 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-439044a1-72e3-4f77-8c69-6f0ca9c167c9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:11.379047 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-108bdc79-cbd7-4496-a558-3636a397be93 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:11.380650 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-108bdc79-cbd7-4496-a558-3636a397be93 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:11.386679 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-439044a1-72e3-4f77-8c69-6f0ca9c167c9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:11.387473 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-439044a1-72e3-4f77-8c69-6f0ca9c167c9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:11.388135 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-439044a1-72e3-4f77-8c69-6f0ca9c167c9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:11.389270 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-439044a1-72e3-4f77-8c69-6f0ca9c167c9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:11.390140 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-439044a1-72e3-4f77-8c69-6f0ca9c167c9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:11.391029 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-439044a1-72e3-4f77-8c69-6f0ca9c167c9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:11.391325 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-108bdc79-cbd7-4496-a558-3636a397be93 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:11.392430 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-108bdc79-cbd7-4496-a558-3636a397be93 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:11.392430 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-108bdc79-cbd7-4496-a558-3636a397be93 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:11.393669 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-108bdc79-cbd7-4496-a558-3636a397be93 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:11.394552 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-108bdc79-cbd7-4496-a558-3636a397be93 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:11.395678 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-108bdc79-cbd7-4496-a558-3636a397be93 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:11.578311 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-439044a1-72e3-4f77-8c69-6f0ca9c167c9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:11.582261 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-108bdc79-cbd7-4496-a558-3636a397be93 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:11.587587 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-439044a1-72e3-4f77-8c69-6f0ca9c167c9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.218882 Sep 13 07:02:11.588167 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 87/160] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:11 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:11.591312 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-108bdc79-cbd7-4496-a558-3636a397be93 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1554 microversion: 2.1 time: 0.218631 Sep 13 07:02:11.591962 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 74/161] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:11 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1554 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:11.592645 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a46b5f46-76f7-4a69-bfbd-76f58797ad84 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:11.593204 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a46b5f46-76f7-4a69-bfbd-76f58797ad84 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:11.601626 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a46b5f46-76f7-4a69-bfbd-76f58797ad84 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:11.602630 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a46b5f46-76f7-4a69-bfbd-76f58797ad84 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:11.603700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a46b5f46-76f7-4a69-bfbd-76f58797ad84 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:11.605226 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a46b5f46-76f7-4a69-bfbd-76f58797ad84 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:11.606028 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a46b5f46-76f7-4a69-bfbd-76f58797ad84 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:11.606540 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a46b5f46-76f7-4a69-bfbd-76f58797ad84 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:11.741361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a46b5f46-76f7-4a69-bfbd-76f58797ad84 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:11.749487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a46b5f46-76f7-4a69-bfbd-76f58797ad84 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1314 microversion: 2.1 time: 0.160325 Sep 13 07:02:11.750051 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 88/162] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:11 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:12.612678 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-01f19353-476e-4031-8ec8-0a8442ee4f66 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:12.612678 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-01f19353-476e-4031-8ec8-0a8442ee4f66 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:12.619722 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-01f19353-476e-4031-8ec8-0a8442ee4f66 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:12.620230 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-01f19353-476e-4031-8ec8-0a8442ee4f66 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:12.620671 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-01f19353-476e-4031-8ec8-0a8442ee4f66 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:12.620958 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6a91736a-a2ee-40a4-9c6a-8b86302d5dc7 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:12.621448 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-01f19353-476e-4031-8ec8-0a8442ee4f66 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:12.621567 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6a91736a-a2ee-40a4-9c6a-8b86302d5dc7 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:12.621874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-01f19353-476e-4031-8ec8-0a8442ee4f66 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:12.622330 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-01f19353-476e-4031-8ec8-0a8442ee4f66 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:12.628458 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a91736a-a2ee-40a4-9c6a-8b86302d5dc7 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:12.629011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a91736a-a2ee-40a4-9c6a-8b86302d5dc7 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:12.629452 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a91736a-a2ee-40a4-9c6a-8b86302d5dc7 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:12.630240 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a91736a-a2ee-40a4-9c6a-8b86302d5dc7 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:12.630740 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a91736a-a2ee-40a4-9c6a-8b86302d5dc7 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:12.631180 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a91736a-a2ee-40a4-9c6a-8b86302d5dc7 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:12.813673 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-01f19353-476e-4031-8ec8-0a8442ee4f66 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:12.818674 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6a91736a-a2ee-40a4-9c6a-8b86302d5dc7 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:12.824554 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-01f19353-476e-4031-8ec8-0a8442ee4f66 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.216374 Sep 13 07:02:12.825154 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 75/163] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:12 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:12.828924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6a91736a-a2ee-40a4-9c6a-8b86302d5dc7 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1554 microversion: 2.1 time: 0.212890 Sep 13 07:02:12.829479 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 89/164] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:12 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1554 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:12.829868 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6be00dd1-91f8-40c1-9399-9bafe25818e5 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:12.830498 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6be00dd1-91f8-40c1-9399-9bafe25818e5 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:12.836581 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6be00dd1-91f8-40c1-9399-9bafe25818e5 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:12.837065 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6be00dd1-91f8-40c1-9399-9bafe25818e5 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:12.837497 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6be00dd1-91f8-40c1-9399-9bafe25818e5 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:12.838196 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6be00dd1-91f8-40c1-9399-9bafe25818e5 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:12.838673 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6be00dd1-91f8-40c1-9399-9bafe25818e5 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:12.839089 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6be00dd1-91f8-40c1-9399-9bafe25818e5 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:12.967895 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6be00dd1-91f8-40c1-9399-9bafe25818e5 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:12.979606 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6be00dd1-91f8-40c1-9399-9bafe25818e5 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1314 microversion: 2.1 time: 0.152950 Sep 13 07:02:12.980379 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 76/165] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:12 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:13.847687 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a2be2925-ad55-4ffd-a658-48c2a55a7297 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:13.848285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a2be2925-ad55-4ffd-a658-48c2a55a7297 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:13.851966 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c44544cc-e94e-4b1e-9039-135561eb1d5d tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:13.852574 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c44544cc-e94e-4b1e-9039-135561eb1d5d tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:13.854550 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2be2925-ad55-4ffd-a658-48c2a55a7297 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:13.855023 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2be2925-ad55-4ffd-a658-48c2a55a7297 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:13.855418 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2be2925-ad55-4ffd-a658-48c2a55a7297 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:13.856347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2be2925-ad55-4ffd-a658-48c2a55a7297 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:13.856856 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2be2925-ad55-4ffd-a658-48c2a55a7297 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:13.857352 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2be2925-ad55-4ffd-a658-48c2a55a7297 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:13.859162 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c44544cc-e94e-4b1e-9039-135561eb1d5d tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:13.859630 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c44544cc-e94e-4b1e-9039-135561eb1d5d tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:13.860275 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c44544cc-e94e-4b1e-9039-135561eb1d5d tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:13.860966 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c44544cc-e94e-4b1e-9039-135561eb1d5d tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:13.861394 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c44544cc-e94e-4b1e-9039-135561eb1d5d tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:13.862015 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c44544cc-e94e-4b1e-9039-135561eb1d5d tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:13.866813 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=100 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:14.063720 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a2be2925-ad55-4ffd-a658-48c2a55a7297 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:14.066722 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c44544cc-e94e-4b1e-9039-135561eb1d5d tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:14.074596 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a2be2925-ad55-4ffd-a658-48c2a55a7297 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.230797 Sep 13 07:02:14.075383 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 90/166] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:13 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:14.080186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a861be93-92ad-4b4b-8445-51287f56b525 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:14.080786 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a861be93-92ad-4b4b-8445-51287f56b525 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:14.086632 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a861be93-92ad-4b4b-8445-51287f56b525 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:14.087112 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a861be93-92ad-4b4b-8445-51287f56b525 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:14.087545 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a861be93-92ad-4b4b-8445-51287f56b525 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:14.087744 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c44544cc-e94e-4b1e-9039-135561eb1d5d tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1554 microversion: 2.1 time: 0.227464 Sep 13 07:02:14.088231 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a861be93-92ad-4b4b-8445-51287f56b525 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:14.088664 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a861be93-92ad-4b4b-8445-51287f56b525 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:14.088961 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 77/167] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:13 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1554 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:02:14.089429 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a861be93-92ad-4b4b-8445-51287f56b525 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:14.231891 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a861be93-92ad-4b4b-8445-51287f56b525 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:14.235442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:14.240080 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a861be93-92ad-4b4b-8445-51287f56b525 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1499 microversion: 2.1 time: 0.163547 Sep 13 07:02:14.240642 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 91/168] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:14 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1499 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:15.103049 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-72651be2-1a43-4326-9e5b-c2981be1e7b8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:15.104182 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-72651be2-1a43-4326-9e5b-c2981be1e7b8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:15.114322 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-72651be2-1a43-4326-9e5b-c2981be1e7b8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:15.115128 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-72651be2-1a43-4326-9e5b-c2981be1e7b8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:15.115845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-72651be2-1a43-4326-9e5b-c2981be1e7b8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:15.116999 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-72651be2-1a43-4326-9e5b-c2981be1e7b8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:15.117466 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-72651be2-1a43-4326-9e5b-c2981be1e7b8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:15.117805 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-72651be2-1a43-4326-9e5b-c2981be1e7b8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:15.118114 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-00c3557a-db1a-46c4-b694-55e7db82a6e6 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:15.118733 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-00c3557a-db1a-46c4-b694-55e7db82a6e6 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:15.134459 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00c3557a-db1a-46c4-b694-55e7db82a6e6 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:15.134957 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00c3557a-db1a-46c4-b694-55e7db82a6e6 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:15.135386 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00c3557a-db1a-46c4-b694-55e7db82a6e6 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:15.136096 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00c3557a-db1a-46c4-b694-55e7db82a6e6 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:15.136551 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00c3557a-db1a-46c4-b694-55e7db82a6e6 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:15.136946 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00c3557a-db1a-46c4-b694-55e7db82a6e6 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:15.325386 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-72651be2-1a43-4326-9e5b-c2981be1e7b8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:15.328601 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-00c3557a-db1a-46c4-b694-55e7db82a6e6 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:15.333823 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-72651be2-1a43-4326-9e5b-c2981be1e7b8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.237650 Sep 13 07:02:15.334434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 78/169] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:15 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:15.338429 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-00c3557a-db1a-46c4-b694-55e7db82a6e6 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1554 microversion: 2.1 time: 0.226495 Sep 13 07:02:15.339001 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 92/170] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:15 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1554 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:16.332959 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-b10f13c7-2b8c-42ba-8778-b5890ccc6476 req-d0a91465-4c40-4c35-a7e8-f48568edc4be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2626a298-4f0c-4116-aa68-f1799bd7b8de", "name": "network-vif-unplugged", "status": "completed", "tag": "15a6822f-f0d2-48e8-8801-aaf402c83509"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:02:16.350192 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-b10f13c7-2b8c-42ba-8778-b5890ccc6476 req-d0a91465-4c40-4c35-a7e8-f48568edc4be service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:16.351217 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-b10f13c7-2b8c-42ba-8778-b5890ccc6476 req-d0a91465-4c40-4c35-a7e8-f48568edc4be service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:16.352090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-b10f13c7-2b8c-42ba-8778-b5890ccc6476 req-d0a91465-4c40-4c35-a7e8-f48568edc4be service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:16.357409 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-691e0341-b3e1-4513-8ed9-038ec39aaff6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:16.357951 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-691e0341-b3e1-4513-8ed9-038ec39aaff6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:16.366059 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-691e0341-b3e1-4513-8ed9-038ec39aaff6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:16.366965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-691e0341-b3e1-4513-8ed9-038ec39aaff6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:16.367775 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-691e0341-b3e1-4513-8ed9-038ec39aaff6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:16.368483 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-691e0341-b3e1-4513-8ed9-038ec39aaff6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:16.369080 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-691e0341-b3e1-4513-8ed9-038ec39aaff6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:16.369651 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-691e0341-b3e1-4513-8ed9-038ec39aaff6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:16.374982 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-b10f13c7-2b8c-42ba-8778-b5890ccc6476 req-d0a91465-4c40-4c35-a7e8-f48568edc4be service nova] Creating event network-vif-unplugged:15a6822f-f0d2-48e8-8801-aaf402c83509 for instance 2626a298-4f0c-4116-aa68-f1799bd7b8de on hv-cinder-85694 Sep 13 07:02:16.380263 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-b10f13c7-2b8c-42ba-8778-b5890ccc6476 req-d0a91465-4c40-4c35-a7e8-f48568edc4be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051021 Sep 13 07:02:16.381398 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 79/171] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:02:16.387747 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9ad5057c-d6d3-4e80-93ad-cf952a3891b8 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:16.388739 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9ad5057c-d6d3-4e80-93ad-cf952a3891b8 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:16.395144 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ad5057c-d6d3-4e80-93ad-cf952a3891b8 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:16.395840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ad5057c-d6d3-4e80-93ad-cf952a3891b8 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:16.396482 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ad5057c-d6d3-4e80-93ad-cf952a3891b8 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:16.397522 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ad5057c-d6d3-4e80-93ad-cf952a3891b8 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:16.398241 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ad5057c-d6d3-4e80-93ad-cf952a3891b8 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:16.398822 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ad5057c-d6d3-4e80-93ad-cf952a3891b8 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:16.723596 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-691e0341-b3e1-4513-8ed9-038ec39aaff6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:16.729951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9ad5057c-d6d3-4e80-93ad-cf952a3891b8 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:16.732383 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-691e0341-b3e1-4513-8ed9-038ec39aaff6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.379474 Sep 13 07:02:16.744041 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9ad5057c-d6d3-4e80-93ad-cf952a3891b8 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1554 microversion: 2.1 time: 0.360471 Sep 13 07:02:16.745669 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 80/172] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:16 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1554 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:16.746257 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 93/173] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:16 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:16.984712 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-97e5ca5f-dc80-4c79-95e8-26ea8d420c97 req-1df405a1-f228-46de-98f4-053d55b55d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2626a298-4f0c-4116-aa68-f1799bd7b8de", "name": "network-vif-deleted", "tag": "15a6822f-f0d2-48e8-8801-aaf402c83509"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:02:16.998551 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-97e5ca5f-dc80-4c79-95e8-26ea8d420c97 req-1df405a1-f228-46de-98f4-053d55b55d0b service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:16.999279 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-97e5ca5f-dc80-4c79-95e8-26ea8d420c97 req-1df405a1-f228-46de-98f4-053d55b55d0b service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:17.002273 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-97e5ca5f-dc80-4c79-95e8-26ea8d420c97 req-1df405a1-f228-46de-98f4-053d55b55d0b service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:17.027535 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-521ee3b9-8449-46dd-b205-923b302bdbdc tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:17.028032 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-521ee3b9-8449-46dd-b205-923b302bdbdc tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:17.031903 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-97e5ca5f-dc80-4c79-95e8-26ea8d420c97 req-1df405a1-f228-46de-98f4-053d55b55d0b service nova] Creating event network-vif-deleted:15a6822f-f0d2-48e8-8801-aaf402c83509 for instance 2626a298-4f0c-4116-aa68-f1799bd7b8de on hv-cinder-85694 Sep 13 07:02:17.038198 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-97e5ca5f-dc80-4c79-95e8-26ea8d420c97 req-1df405a1-f228-46de-98f4-053d55b55d0b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062704 Sep 13 07:02:17.039408 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 81/174] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:02:17.040130 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-521ee3b9-8449-46dd-b205-923b302bdbdc tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:17.040631 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-521ee3b9-8449-46dd-b205-923b302bdbdc tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:17.041067 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-521ee3b9-8449-46dd-b205-923b302bdbdc tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:17.041777 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-521ee3b9-8449-46dd-b205-923b302bdbdc tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:17.042297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-521ee3b9-8449-46dd-b205-923b302bdbdc tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:17.042726 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-521ee3b9-8449-46dd-b205-923b302bdbdc tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:17.070799 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-521ee3b9-8449-46dd-b205-923b302bdbdc tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:02:17.168106 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-521ee3b9-8449-46dd-b205-923b302bdbdc tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 204 len: 0 microversion: 2.1 time: 0.143095 Sep 13 07:02:17.168980 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 94/175] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:02:17 2022] DELETE /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 07:02:17.177890 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-059b4d3c-5616-4ee7-940b-92c3bfdafa95 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:17.178635 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-059b4d3c-5616-4ee7-940b-92c3bfdafa95 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:17.185662 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-059b4d3c-5616-4ee7-940b-92c3bfdafa95 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:17.186254 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-059b4d3c-5616-4ee7-940b-92c3bfdafa95 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:17.186716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-059b4d3c-5616-4ee7-940b-92c3bfdafa95 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:17.187416 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-059b4d3c-5616-4ee7-940b-92c3bfdafa95 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:17.187867 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-059b4d3c-5616-4ee7-940b-92c3bfdafa95 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:17.188283 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-059b4d3c-5616-4ee7-940b-92c3bfdafa95 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:17.352214 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-059b4d3c-5616-4ee7-940b-92c3bfdafa95 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:17.361522 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-059b4d3c-5616-4ee7-940b-92c3bfdafa95 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1505 microversion: 2.1 time: 0.187737 Sep 13 07:02:17.362228 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 82/176] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:17 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1505 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:17.759160 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-215e7949-ba06-4307-95fa-445a144792e1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:17.759927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-215e7949-ba06-4307-95fa-445a144792e1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:17.770777 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d5be5f1d-d3e7-4d06-a185-bb34c378f239 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:17.771679 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d5be5f1d-d3e7-4d06-a185-bb34c378f239 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:17.771831 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-215e7949-ba06-4307-95fa-445a144792e1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:17.772317 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-215e7949-ba06-4307-95fa-445a144792e1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:17.772748 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-215e7949-ba06-4307-95fa-445a144792e1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:17.773483 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-215e7949-ba06-4307-95fa-445a144792e1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:17.774187 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-215e7949-ba06-4307-95fa-445a144792e1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:17.774554 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-215e7949-ba06-4307-95fa-445a144792e1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:17.783090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5be5f1d-d3e7-4d06-a185-bb34c378f239 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:17.783687 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5be5f1d-d3e7-4d06-a185-bb34c378f239 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:17.784470 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5be5f1d-d3e7-4d06-a185-bb34c378f239 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:17.785402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5be5f1d-d3e7-4d06-a185-bb34c378f239 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:17.786036 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5be5f1d-d3e7-4d06-a185-bb34c378f239 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:17.786952 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5be5f1d-d3e7-4d06-a185-bb34c378f239 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:17.901907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d5be5f1d-d3e7-4d06-a185-bb34c378f239 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:17.911318 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d5be5f1d-d3e7-4d06-a185-bb34c378f239 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1346 microversion: 2.1 time: 0.146019 Sep 13 07:02:17.929192 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 83/177] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:17 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1346 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:17.979298 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-215e7949-ba06-4307-95fa-445a144792e1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:17.987833 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-215e7949-ba06-4307-95fa-445a144792e1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.235172 Sep 13 07:02:17.988439 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 95/178] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:17 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:18.386007 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-af77f4bf-7f77-4968-9ef0-0247eb6e82f2 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:18.386648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-af77f4bf-7f77-4968-9ef0-0247eb6e82f2 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:18.393540 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af77f4bf-7f77-4968-9ef0-0247eb6e82f2 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:18.394006 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af77f4bf-7f77-4968-9ef0-0247eb6e82f2 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:18.394468 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af77f4bf-7f77-4968-9ef0-0247eb6e82f2 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:18.395152 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af77f4bf-7f77-4968-9ef0-0247eb6e82f2 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:18.395568 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af77f4bf-7f77-4968-9ef0-0247eb6e82f2 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:18.396005 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af77f4bf-7f77-4968-9ef0-0247eb6e82f2 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:18.533892 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-af77f4bf-7f77-4968-9ef0-0247eb6e82f2 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:18.541882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-af77f4bf-7f77-4968-9ef0-0247eb6e82f2 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1505 microversion: 2.1 time: 0.160015 Sep 13 07:02:18.542568 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 84/179] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:18 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:18.935762 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c6f71fd5-1de6-494a-957f-a9c2921377d1 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:18.936322 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c6f71fd5-1de6-494a-957f-a9c2921377d1 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:18.942676 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6f71fd5-1de6-494a-957f-a9c2921377d1 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:18.943161 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6f71fd5-1de6-494a-957f-a9c2921377d1 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:18.943585 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6f71fd5-1de6-494a-957f-a9c2921377d1 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:18.944266 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6f71fd5-1de6-494a-957f-a9c2921377d1 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:18.944717 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6f71fd5-1de6-494a-957f-a9c2921377d1 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:18.945132 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6f71fd5-1de6-494a-957f-a9c2921377d1 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:19.006074 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c6f71fd5-1de6-494a-957f-a9c2921377d1 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:19.010828 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6021a683-e391-41de-90f6-3fdac969b066 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:19.011728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6021a683-e391-41de-90f6-3fdac969b066 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:19.015991 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c6f71fd5-1de6-494a-957f-a9c2921377d1 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1346 microversion: 2.1 time: 0.084094 Sep 13 07:02:19.016573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 96/180] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:18 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:19.035024 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6021a683-e391-41de-90f6-3fdac969b066 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:19.035743 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6021a683-e391-41de-90f6-3fdac969b066 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:19.036177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6021a683-e391-41de-90f6-3fdac969b066 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:19.036885 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6021a683-e391-41de-90f6-3fdac969b066 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:19.037336 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6021a683-e391-41de-90f6-3fdac969b066 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:19.037752 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6021a683-e391-41de-90f6-3fdac969b066 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:19.172482 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6021a683-e391-41de-90f6-3fdac969b066 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:19.180343 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6021a683-e391-41de-90f6-3fdac969b066 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.173587 Sep 13 07:02:19.181437 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 85/181] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:19 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:19.566027 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1dbe56c4-69bb-45e6-8368-decb48d9057a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:19.566670 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1dbe56c4-69bb-45e6-8368-decb48d9057a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:19.573550 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1dbe56c4-69bb-45e6-8368-decb48d9057a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:19.574422 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1dbe56c4-69bb-45e6-8368-decb48d9057a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:19.574930 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1dbe56c4-69bb-45e6-8368-decb48d9057a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:19.575615 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1dbe56c4-69bb-45e6-8368-decb48d9057a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:19.576060 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1dbe56c4-69bb-45e6-8368-decb48d9057a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:19.576471 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1dbe56c4-69bb-45e6-8368-decb48d9057a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:19.772730 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1dbe56c4-69bb-45e6-8368-decb48d9057a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:19.781353 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1dbe56c4-69bb-45e6-8368-decb48d9057a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1505 microversion: 2.1 time: 0.219473 Sep 13 07:02:19.782178 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 97/182] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:19 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1505 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:20.042395 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-270940e0-d600-45a5-a391-d1c3fb2c38ff tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:20.042979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-270940e0-d600-45a5-a391-d1c3fb2c38ff tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:20.050034 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-270940e0-d600-45a5-a391-d1c3fb2c38ff tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:20.050544 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-270940e0-d600-45a5-a391-d1c3fb2c38ff tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:20.050968 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-270940e0-d600-45a5-a391-d1c3fb2c38ff tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:20.051652 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-270940e0-d600-45a5-a391-d1c3fb2c38ff tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:20.052091 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-270940e0-d600-45a5-a391-d1c3fb2c38ff tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:20.052503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-270940e0-d600-45a5-a391-d1c3fb2c38ff tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:20.120650 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-270940e0-d600-45a5-a391-d1c3fb2c38ff tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:20.129119 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-270940e0-d600-45a5-a391-d1c3fb2c38ff tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1346 microversion: 2.1 time: 0.091090 Sep 13 07:02:20.129770 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 86/183] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:20 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:20.202958 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-aafcef58-f0f8-49e0-acfe-74c0015170fe tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:20.203777 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-aafcef58-f0f8-49e0-acfe-74c0015170fe tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:20.210066 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aafcef58-f0f8-49e0-acfe-74c0015170fe tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:20.210630 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aafcef58-f0f8-49e0-acfe-74c0015170fe tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:20.211151 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aafcef58-f0f8-49e0-acfe-74c0015170fe tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:20.211907 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aafcef58-f0f8-49e0-acfe-74c0015170fe tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:20.212422 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aafcef58-f0f8-49e0-acfe-74c0015170fe tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:20.212904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aafcef58-f0f8-49e0-acfe-74c0015170fe tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:20.350708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-aafcef58-f0f8-49e0-acfe-74c0015170fe tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:20.361951 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-aafcef58-f0f8-49e0-acfe-74c0015170fe tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.162755 Sep 13 07:02:20.363285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 98/184] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:20 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:20.804573 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8c22af34-7e17-40f3-b407-68e8d0e56c90 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:20.805286 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8c22af34-7e17-40f3-b407-68e8d0e56c90 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:20.812157 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8c22af34-7e17-40f3-b407-68e8d0e56c90 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:20.812621 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8c22af34-7e17-40f3-b407-68e8d0e56c90 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:20.813051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8c22af34-7e17-40f3-b407-68e8d0e56c90 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:20.813747 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8c22af34-7e17-40f3-b407-68e8d0e56c90 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:20.814419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8c22af34-7e17-40f3-b407-68e8d0e56c90 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:20.815021 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8c22af34-7e17-40f3-b407-68e8d0e56c90 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:20.950419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8c22af34-7e17-40f3-b407-68e8d0e56c90 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:20.959277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8c22af34-7e17-40f3-b407-68e8d0e56c90 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1505 microversion: 2.1 time: 0.158619 Sep 13 07:02:20.959842 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 87/185] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:20 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:21.153369 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5b082f9d-be26-455d-a5ce-e2a0d90261ed tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:21.154095 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5b082f9d-be26-455d-a5ce-e2a0d90261ed tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:21.160748 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5b082f9d-be26-455d-a5ce-e2a0d90261ed tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:21.161380 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5b082f9d-be26-455d-a5ce-e2a0d90261ed tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:21.161912 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5b082f9d-be26-455d-a5ce-e2a0d90261ed tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:21.162774 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5b082f9d-be26-455d-a5ce-e2a0d90261ed tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:21.163458 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5b082f9d-be26-455d-a5ce-e2a0d90261ed tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:21.164040 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5b082f9d-be26-455d-a5ce-e2a0d90261ed tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:21.231816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5b082f9d-be26-455d-a5ce-e2a0d90261ed tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:21.240163 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5b082f9d-be26-455d-a5ce-e2a0d90261ed tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1346 microversion: 2.1 time: 0.090695 Sep 13 07:02:21.240660 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 99/186] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:21 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:21.386244 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0a27c0ef-4660-473c-95e7-78da352ab9ba tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:21.386900 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0a27c0ef-4660-473c-95e7-78da352ab9ba tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:21.393729 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0a27c0ef-4660-473c-95e7-78da352ab9ba tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:21.394281 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0a27c0ef-4660-473c-95e7-78da352ab9ba tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:21.394691 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0a27c0ef-4660-473c-95e7-78da352ab9ba tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:21.395395 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0a27c0ef-4660-473c-95e7-78da352ab9ba tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:21.395839 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0a27c0ef-4660-473c-95e7-78da352ab9ba tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:21.396240 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0a27c0ef-4660-473c-95e7-78da352ab9ba tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:21.528823 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0a27c0ef-4660-473c-95e7-78da352ab9ba tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:21.536750 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0a27c0ef-4660-473c-95e7-78da352ab9ba tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.154771 Sep 13 07:02:21.537323 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 88/187] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:21 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:21.984734 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f1e5fec6-87db-4a7a-abf4-1b004e5228d3 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:21.985335 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f1e5fec6-87db-4a7a-abf4-1b004e5228d3 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:21.991731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f1e5fec6-87db-4a7a-abf4-1b004e5228d3 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:21.992205 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f1e5fec6-87db-4a7a-abf4-1b004e5228d3 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:21.992631 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f1e5fec6-87db-4a7a-abf4-1b004e5228d3 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:21.993298 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f1e5fec6-87db-4a7a-abf4-1b004e5228d3 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:21.993839 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f1e5fec6-87db-4a7a-abf4-1b004e5228d3 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:21.994285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f1e5fec6-87db-4a7a-abf4-1b004e5228d3 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:22.137722 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f1e5fec6-87db-4a7a-abf4-1b004e5228d3 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:22.147732 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f1e5fec6-87db-4a7a-abf4-1b004e5228d3 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1505 microversion: 2.1 time: 0.166687 Sep 13 07:02:22.148900 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 100/188] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:21 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:22.271977 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c8231e4f-f651-457e-90cf-b1127d8c087a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:22.272822 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c8231e4f-f651-457e-90cf-b1127d8c087a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:22.280183 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c8231e4f-f651-457e-90cf-b1127d8c087a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:22.281098 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c8231e4f-f651-457e-90cf-b1127d8c087a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:22.281682 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c8231e4f-f651-457e-90cf-b1127d8c087a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:22.282546 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c8231e4f-f651-457e-90cf-b1127d8c087a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:22.283135 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c8231e4f-f651-457e-90cf-b1127d8c087a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:22.283711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c8231e4f-f651-457e-90cf-b1127d8c087a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:22.337156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c8231e4f-f651-457e-90cf-b1127d8c087a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:22.338337 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c8231e4f-f651-457e-90cf-b1127d8c087a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:22.338805 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c8231e4f-f651-457e-90cf-b1127d8c087a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:22.339260 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-c8231e4f-f651-457e-90cf-b1127d8c087a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lazy-loading 'fault' on Instance uuid 2626a298-4f0c-4116-aa68-f1799bd7b8de {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:02:22.396392 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c8231e4f-f651-457e-90cf-b1127d8c087a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:22.406856 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c8231e4f-f651-457e-90cf-b1127d8c087a tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1351 microversion: 2.1 time: 0.139955 Sep 13 07:02:22.407758 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 89/189] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:22 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1351 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:22.575576 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f2bc0694-24d7-4391-89a2-56cfb46063c0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:22.576187 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f2bc0694-24d7-4391-89a2-56cfb46063c0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:22.583425 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2bc0694-24d7-4391-89a2-56cfb46063c0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:22.584158 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2bc0694-24d7-4391-89a2-56cfb46063c0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:22.584864 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2bc0694-24d7-4391-89a2-56cfb46063c0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:22.585602 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2bc0694-24d7-4391-89a2-56cfb46063c0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:22.586053 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2bc0694-24d7-4391-89a2-56cfb46063c0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:22.586587 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2bc0694-24d7-4391-89a2-56cfb46063c0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:22.692913 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-3c40f34f-3c7e-4144-89da-410cf18a98e2 req-392d4c11-f031-4e5b-b807-85cf7cc664e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa", "name": "network-vif-deleted", "tag": "d54180b0-de96-4099-b8c9-e23302999315"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:02:22.703559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-3c40f34f-3c7e-4144-89da-410cf18a98e2 req-392d4c11-f031-4e5b-b807-85cf7cc664e6 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:22.704035 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-3c40f34f-3c7e-4144-89da-410cf18a98e2 req-392d4c11-f031-4e5b-b807-85cf7cc664e6 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:22.704644 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-3c40f34f-3c7e-4144-89da-410cf18a98e2 req-392d4c11-f031-4e5b-b807-85cf7cc664e6 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:22.716099 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-3c40f34f-3c7e-4144-89da-410cf18a98e2 req-392d4c11-f031-4e5b-b807-85cf7cc664e6 service nova] Creating event network-vif-deleted:d54180b0-de96-4099-b8c9-e23302999315 for instance 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa on hv-cinder-85694 Sep 13 07:02:22.721060 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-3c40f34f-3c7e-4144-89da-410cf18a98e2 req-392d4c11-f031-4e5b-b807-85cf7cc664e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037650 Sep 13 07:02:22.721717 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 90/190] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:02:22.745189 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f2bc0694-24d7-4391-89a2-56cfb46063c0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:22.753010 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f2bc0694-24d7-4391-89a2-56cfb46063c0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.196106 Sep 13 07:02:22.753603 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 101/191] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:22 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:23.172527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-60c00ce1-a54b-4d2b-93ed-48b9d7b4dd19 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:23.173310 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-60c00ce1-a54b-4d2b-93ed-48b9d7b4dd19 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:23.180102 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-60c00ce1-a54b-4d2b-93ed-48b9d7b4dd19 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:23.180584 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-60c00ce1-a54b-4d2b-93ed-48b9d7b4dd19 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:23.181353 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-60c00ce1-a54b-4d2b-93ed-48b9d7b4dd19 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:23.182388 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-60c00ce1-a54b-4d2b-93ed-48b9d7b4dd19 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:23.182933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-60c00ce1-a54b-4d2b-93ed-48b9d7b4dd19 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:23.183413 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-60c00ce1-a54b-4d2b-93ed-48b9d7b4dd19 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:23.215949 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-60c00ce1-a54b-4d2b-93ed-48b9d7b4dd19 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:23.216425 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-60c00ce1-a54b-4d2b-93ed-48b9d7b4dd19 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:23.216852 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-60c00ce1-a54b-4d2b-93ed-48b9d7b4dd19 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:23.217261 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-60c00ce1-a54b-4d2b-93ed-48b9d7b4dd19 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lazy-loading 'fault' on Instance uuid 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:02:23.259554 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-60c00ce1-a54b-4d2b-93ed-48b9d7b4dd19 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:23.267454 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-60c00ce1-a54b-4d2b-93ed-48b9d7b4dd19 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1304 microversion: 2.1 time: 0.099239 Sep 13 07:02:23.268023 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 91/192] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:23 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:23.441808 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-643ea33c-a3ff-4e68-bfe3-6f538853a0dd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:23.442509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-643ea33c-a3ff-4e68-bfe3-6f538853a0dd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:23.449666 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-643ea33c-a3ff-4e68-bfe3-6f538853a0dd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:23.450169 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-643ea33c-a3ff-4e68-bfe3-6f538853a0dd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:23.450596 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-643ea33c-a3ff-4e68-bfe3-6f538853a0dd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:23.451336 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-643ea33c-a3ff-4e68-bfe3-6f538853a0dd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:23.451783 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-643ea33c-a3ff-4e68-bfe3-6f538853a0dd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:23.452184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-643ea33c-a3ff-4e68-bfe3-6f538853a0dd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:23.484272 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-643ea33c-a3ff-4e68-bfe3-6f538853a0dd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:23.484751 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-643ea33c-a3ff-4e68-bfe3-6f538853a0dd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:23.485179 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-643ea33c-a3ff-4e68-bfe3-6f538853a0dd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:23.485615 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-643ea33c-a3ff-4e68-bfe3-6f538853a0dd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lazy-loading 'fault' on Instance uuid 2626a298-4f0c-4116-aa68-f1799bd7b8de {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:02:23.529933 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-643ea33c-a3ff-4e68-bfe3-6f538853a0dd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23088396d0ca47c5929690820a3f7e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d415383e1c1471aae5712893d48c2b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:23.539749 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-643ea33c-a3ff-4e68-bfe3-6f538853a0dd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 200 len: 1351 microversion: 2.1 time: 0.101841 Sep 13 07:02:23.540331 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 102/193] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:23 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 1351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:23.776097 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c16a28ca-25b8-41ec-b017-66e62b8cf03a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:23.777748 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c16a28ca-25b8-41ec-b017-66e62b8cf03a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:23.783319 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c16a28ca-25b8-41ec-b017-66e62b8cf03a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:23.783810 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c16a28ca-25b8-41ec-b017-66e62b8cf03a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:23.784238 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c16a28ca-25b8-41ec-b017-66e62b8cf03a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:23.784931 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c16a28ca-25b8-41ec-b017-66e62b8cf03a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:23.785382 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c16a28ca-25b8-41ec-b017-66e62b8cf03a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:23.785801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c16a28ca-25b8-41ec-b017-66e62b8cf03a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:23.918165 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c16a28ca-25b8-41ec-b017-66e62b8cf03a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:23.926733 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c16a28ca-25b8-41ec-b017-66e62b8cf03a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.154558 Sep 13 07:02:23.927315 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 92/194] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:23 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:24.291176 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3f7bf863-3ffd-4d69-b48c-e2551949c23d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:24.291775 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3f7bf863-3ffd-4d69-b48c-e2551949c23d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:24.298249 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f7bf863-3ffd-4d69-b48c-e2551949c23d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:24.299006 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f7bf863-3ffd-4d69-b48c-e2551949c23d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:24.299607 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f7bf863-3ffd-4d69-b48c-e2551949c23d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:24.300289 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f7bf863-3ffd-4d69-b48c-e2551949c23d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:24.300929 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f7bf863-3ffd-4d69-b48c-e2551949c23d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:24.301337 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f7bf863-3ffd-4d69-b48c-e2551949c23d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:24.340047 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f7bf863-3ffd-4d69-b48c-e2551949c23d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:24.340689 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f7bf863-3ffd-4d69-b48c-e2551949c23d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:24.341738 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f7bf863-3ffd-4d69-b48c-e2551949c23d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:24.342639 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-3f7bf863-3ffd-4d69-b48c-e2551949c23d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lazy-loading 'fault' on Instance uuid 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:02:24.406494 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3f7bf863-3ffd-4d69-b48c-e2551949c23d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:24.415424 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3f7bf863-3ffd-4d69-b48c-e2551949c23d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1304 microversion: 2.1 time: 0.127992 Sep 13 07:02:24.416060 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 103/195] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:24 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1304 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:02:24.563792 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2bec7630-3017-4f24-b170-10b09da76896 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:24.565125 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2bec7630-3017-4f24-b170-10b09da76896 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:24.572550 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2bec7630-3017-4f24-b170-10b09da76896 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:24.574108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2bec7630-3017-4f24-b170-10b09da76896 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:24.574770 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2bec7630-3017-4f24-b170-10b09da76896 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:24.577296 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2bec7630-3017-4f24-b170-10b09da76896 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:24.577958 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2bec7630-3017-4f24-b170-10b09da76896 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:24.578757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2bec7630-3017-4f24-b170-10b09da76896 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:24.604792 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-2bec7630-3017-4f24-b170-10b09da76896 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] HTTP exception thrown: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. Sep 13 07:02:24.617503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2bec7630-3017-4f24-b170-10b09da76896 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Request method failure captured: Sep 13 07:02:24.617503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de HTTP/1.1 Sep 13 07:02:24.617503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:02:24.617503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:02:24.617503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:02:24.617503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:02:24.617503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:02:24.617503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:02:24.617503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:02:24.617503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:02:24.617503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICq71RlDvVABkk4L09BG3wcxYxR4PecCxVDGv1NyIPOQz7jSIiHn_e6Y7zt95fFdM9H5eKsz-TQ2S6BF9WW_OYaxEoqin0hTPozaIKyfrAvinf4z92DfgiWaV4wpua-pXMcSnQUwAbR2dCACIc60CCtpPHgkkBbxeIeDMHEYT2l-5jk Sep 13 07:02:24.617503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:02:24.617503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:02:24.617503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:02:24.617503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:02:24.617503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:02:24.617503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:02:24.617503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: 5d415383e1c1471aae5712893d48c2b6 Sep 13 07:02:24.617503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-DeleteServersTestJSON-509853679 Sep 13 07:02:24.617503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:02:24.617503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:02:24.618813 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5d415383e1c1471aae5712893d48c2b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d415383e1c1471aae5712893d48c2b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d415383e1c1471aae5712893d48c2b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5d415383e1c1471aae5712893d48c2b6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:02:24.618813 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-DeleteServersTestJSON-509853679 Sep 13 07:02:24.618813 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 5d415383e1c1471aae5712893d48c2b6 Sep 13 07:02:24.618813 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-DeleteServersTestJSON-509853679 Sep 13 07:02:24.618813 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-DeleteServersTestJSON-509853679-project Sep 13 07:02:24.618813 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:02:24.618813 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:02:24.618813 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: 23088396d0ca47c5929690820a3f7e29 Sep 13 07:02:24.618813 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-DeleteServersTestJSON-509853679-project Sep 13 07:02:24.618813 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:02:24.618813 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. Sep 13 07:02:24.618813 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': '2626a298-4f0c-4116-aa68-f1799bd7b8de'} Sep 13 07:02:24.619527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:02:24.619527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:02:24.619527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:02:24.619527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:02:24.619527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:02:24.619527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:02:24.619527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:02:24.619527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:02:24.619527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:02:24.619527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:02:24.619527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. Sep 13 07:02:24.619527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:02:24.619527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:02:24.619527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:02:24.619527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:02:24.619527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:02:24.619527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:02:24.619527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:02:24.619527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:02:24.619527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:02:24.622277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:02:24.622277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:02:24.622277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:02:24.622277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:02:24.622277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:02:24.622277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:02:24.622277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:02:24.622277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. Sep 13 07:02:24.622277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:02:24.622277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:02:24.622277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:02:24.622277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:02:24.622277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:02:24.622277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:02:24.622277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:02:24.622277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:02:24.622277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. Sep 13 07:02:24.622277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:02:24.624127 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2bec7630-3017-4f24-b170-10b09da76896 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Returning 404 to user: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:02:24.624127 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2bec7630-3017-4f24-b170-10b09da76896 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 404 len: 111 microversion: 2.1 time: 0.059686 Sep 13 07:02:24.624127 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 93/196] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:24 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:02:24.739342 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a7f8ea66-1c04-4c96-ab8e-5c06cb1f6802 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:24.741581 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a7f8ea66-1c04-4c96-ab8e-5c06cb1f6802 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:24.747947 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7f8ea66-1c04-4c96-ab8e-5c06cb1f6802 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:24.748427 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7f8ea66-1c04-4c96-ab8e-5c06cb1f6802 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:24.748856 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7f8ea66-1c04-4c96-ab8e-5c06cb1f6802 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:24.749542 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7f8ea66-1c04-4c96-ab8e-5c06cb1f6802 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:24.749986 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7f8ea66-1c04-4c96-ab8e-5c06cb1f6802 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:24.750445 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7f8ea66-1c04-4c96-ab8e-5c06cb1f6802 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:24.763712 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-a7f8ea66-1c04-4c96-ab8e-5c06cb1f6802 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] HTTP exception thrown: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. Sep 13 07:02:24.767837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a7f8ea66-1c04-4c96-ab8e-5c06cb1f6802 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Request method failure captured: Sep 13 07:02:24.767837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de/os-volume_attachments HTTP/1.1 Sep 13 07:02:24.767837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:02:24.767837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:02:24.767837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:02:24.767837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:02:24.767837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:02:24.767837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:02:24.767837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:02:24.767837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:02:24.767837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICq71RlDvVABkk4L09BG3wcxYxR4PecCxVDGv1NyIPOQz7jSIiHn_e6Y7zt95fFdM9H5eKsz-TQ2S6BF9WW_OYaxEoqin0hTPozaIKyfrAvinf4z92DfgiWaV4wpua-pXMcSnQUwAbR2dCACIc60CCtpPHgkkBbxeIeDMHEYT2l-5jk Sep 13 07:02:24.767837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:02:24.767837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:02:24.767837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:02:24.767837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:02:24.767837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:02:24.767837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:02:24.767837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 5d415383e1c1471aae5712893d48c2b6 Sep 13 07:02:24.767837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-DeleteServersTestJSON-509853679 Sep 13 07:02:24.767837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:02:24.767837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:02:24.769258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5d415383e1c1471aae5712893d48c2b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d415383e1c1471aae5712893d48c2b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d415383e1c1471aae5712893d48c2b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5d415383e1c1471aae5712893d48c2b6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:02:24.769258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-DeleteServersTestJSON-509853679 Sep 13 07:02:24.769258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 5d415383e1c1471aae5712893d48c2b6 Sep 13 07:02:24.769258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-DeleteServersTestJSON-509853679 Sep 13 07:02:24.769258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-DeleteServersTestJSON-509853679-project Sep 13 07:02:24.769258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:02:24.769258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:02:24.769258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 23088396d0ca47c5929690820a3f7e29 Sep 13 07:02:24.769258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-DeleteServersTestJSON-509853679-project Sep 13 07:02:24.769258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:02:24.769258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. Sep 13 07:02:24.769258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'server_id': '2626a298-4f0c-4116-aa68-f1799bd7b8de'} Sep 13 07:02:24.770057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:02:24.770057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:02:24.770057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:02:24.770057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:02:24.770057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:02:24.770057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:02:24.770057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:02:24.770057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:02:24.770057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:02:24.770057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:02:24.770057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. Sep 13 07:02:24.770057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:02:24.770057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:02:24.770057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:02:24.770057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:02:24.770057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:02:24.770057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:02:24.770057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:02:24.770057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:02:24.770057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:02:24.771234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:02:24.771234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 07:02:24.771234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 07:02:24.771234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 07:02:24.771234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 07:02:24.771234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 13 07:02:24.771234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 13 07:02:24.771234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:02:24.771234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:02:24.771234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. Sep 13 07:02:24.771234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:02:24.771234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:02:24.771234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:02:24.771234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:02:24.771234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:02:24.771234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:02:24.771234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:02:24.771234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:02:24.771234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. Sep 13 07:02:24.771234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:02:24.772475 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a7f8ea66-1c04-4c96-ab8e-5c06cb1f6802 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Returning 404 to user: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:02:24.772475 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a7f8ea66-1c04-4c96-ab8e-5c06cb1f6802 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033916 Sep 13 07:02:24.772475 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 104/197] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Sep 13 07:02:24 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:02:24.954649 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ab0877fc-f7b5-4710-af2f-e588d2d22e93 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:24.955423 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ab0877fc-f7b5-4710-af2f-e588d2d22e93 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:24.962702 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ab0877fc-f7b5-4710-af2f-e588d2d22e93 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:24.963177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ab0877fc-f7b5-4710-af2f-e588d2d22e93 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:24.963605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ab0877fc-f7b5-4710-af2f-e588d2d22e93 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:24.964479 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ab0877fc-f7b5-4710-af2f-e588d2d22e93 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:24.964907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ab0877fc-f7b5-4710-af2f-e588d2d22e93 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:24.965444 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ab0877fc-f7b5-4710-af2f-e588d2d22e93 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:25.092571 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ab0877fc-f7b5-4710-af2f-e588d2d22e93 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:25.101597 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ab0877fc-f7b5-4710-af2f-e588d2d22e93 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.151055 Sep 13 07:02:25.102174 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 94/198] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:24 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:25.438664 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a3466ed9-5fcd-40ab-af3e-52b106f83b22 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:25.439425 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a3466ed9-5fcd-40ab-af3e-52b106f83b22 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:25.445450 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a3466ed9-5fcd-40ab-af3e-52b106f83b22 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:25.445923 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a3466ed9-5fcd-40ab-af3e-52b106f83b22 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:25.446380 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a3466ed9-5fcd-40ab-af3e-52b106f83b22 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:25.447262 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a3466ed9-5fcd-40ab-af3e-52b106f83b22 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:25.447691 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a3466ed9-5fcd-40ab-af3e-52b106f83b22 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:25.448100 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a3466ed9-5fcd-40ab-af3e-52b106f83b22 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:25.480101 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a3466ed9-5fcd-40ab-af3e-52b106f83b22 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:25.480547 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a3466ed9-5fcd-40ab-af3e-52b106f83b22 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:25.481024 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a3466ed9-5fcd-40ab-af3e-52b106f83b22 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:25.481432 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-a3466ed9-5fcd-40ab-af3e-52b106f83b22 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lazy-loading 'fault' on Instance uuid 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:02:25.524379 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a3466ed9-5fcd-40ab-af3e-52b106f83b22 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:25.534415 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a3466ed9-5fcd-40ab-af3e-52b106f83b22 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1304 microversion: 2.1 time: 0.099602 Sep 13 07:02:25.535045 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 105/199] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:25 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:26.125546 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5d5bfcc3-ef98-4f3c-bfe6-2cb827520fb1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:26.126449 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5d5bfcc3-ef98-4f3c-bfe6-2cb827520fb1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:26.132782 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5d5bfcc3-ef98-4f3c-bfe6-2cb827520fb1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:26.133284 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5d5bfcc3-ef98-4f3c-bfe6-2cb827520fb1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:26.133737 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5d5bfcc3-ef98-4f3c-bfe6-2cb827520fb1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:26.134468 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5d5bfcc3-ef98-4f3c-bfe6-2cb827520fb1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:26.134919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5d5bfcc3-ef98-4f3c-bfe6-2cb827520fb1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:26.135338 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5d5bfcc3-ef98-4f3c-bfe6-2cb827520fb1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:26.272343 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5d5bfcc3-ef98-4f3c-bfe6-2cb827520fb1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:26.275876 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=100 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:26.281403 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5d5bfcc3-ef98-4f3c-bfe6-2cb827520fb1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.160090 Sep 13 07:02:26.282180 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 95/200] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:26 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:26.559688 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ec1ae2c7-b4cf-41d5-b905-5cbd48f975d7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:26.560297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ec1ae2c7-b4cf-41d5-b905-5cbd48f975d7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:26.568160 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ec1ae2c7-b4cf-41d5-b905-5cbd48f975d7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:26.568631 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ec1ae2c7-b4cf-41d5-b905-5cbd48f975d7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:26.569060 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ec1ae2c7-b4cf-41d5-b905-5cbd48f975d7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:26.569941 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ec1ae2c7-b4cf-41d5-b905-5cbd48f975d7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:26.570595 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ec1ae2c7-b4cf-41d5-b905-5cbd48f975d7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:26.570916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ec1ae2c7-b4cf-41d5-b905-5cbd48f975d7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:26.591507 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:26.612852 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ec1ae2c7-b4cf-41d5-b905-5cbd48f975d7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:26.613687 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ec1ae2c7-b4cf-41d5-b905-5cbd48f975d7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:26.613829 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ec1ae2c7-b4cf-41d5-b905-5cbd48f975d7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:26.614295 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-ec1ae2c7-b4cf-41d5-b905-5cbd48f975d7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lazy-loading 'fault' on Instance uuid 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:02:26.671340 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ec1ae2c7-b4cf-41d5-b905-5cbd48f975d7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:26.679268 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ec1ae2c7-b4cf-41d5-b905-5cbd48f975d7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 200 len: 1304 microversion: 2.1 time: 0.124429 Sep 13 07:02:26.679830 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 106/201] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:26 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:27.304576 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a11e4bba-5a3f-4e0d-92e3-d62dca52cd69 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:27.305156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a11e4bba-5a3f-4e0d-92e3-d62dca52cd69 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:27.312767 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a11e4bba-5a3f-4e0d-92e3-d62dca52cd69 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:27.313331 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a11e4bba-5a3f-4e0d-92e3-d62dca52cd69 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:27.313848 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a11e4bba-5a3f-4e0d-92e3-d62dca52cd69 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:27.314629 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a11e4bba-5a3f-4e0d-92e3-d62dca52cd69 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:27.315295 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a11e4bba-5a3f-4e0d-92e3-d62dca52cd69 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:27.315777 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a11e4bba-5a3f-4e0d-92e3-d62dca52cd69 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:27.449487 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a11e4bba-5a3f-4e0d-92e3-d62dca52cd69 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:27.458162 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a11e4bba-5a3f-4e0d-92e3-d62dca52cd69 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.157462 Sep 13 07:02:27.460122 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 96/202] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:27 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:27.702943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fb1f1d62-6811-4872-8bbb-f4cc0d35b266 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:27.703542 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fb1f1d62-6811-4872-8bbb-f4cc0d35b266 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:27.711182 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb1f1d62-6811-4872-8bbb-f4cc0d35b266 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:27.711698 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb1f1d62-6811-4872-8bbb-f4cc0d35b266 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:27.712119 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb1f1d62-6811-4872-8bbb-f4cc0d35b266 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:27.712929 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb1f1d62-6811-4872-8bbb-f4cc0d35b266 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:27.713281 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb1f1d62-6811-4872-8bbb-f4cc0d35b266 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:27.713767 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb1f1d62-6811-4872-8bbb-f4cc0d35b266 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:27.727501 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-fb1f1d62-6811-4872-8bbb-f4cc0d35b266 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] HTTP exception thrown: Instance 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa could not be found. Sep 13 07:02:27.729906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fb1f1d62-6811-4872-8bbb-f4cc0d35b266 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Request method failure captured: Sep 13 07:02:27.729906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa HTTP/1.1 Sep 13 07:02:27.729906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:02:27.729906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:02:27.729906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:02:27.729906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:02:27.729906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:02:27.729906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:02:27.729906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:02:27.729906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:02:27.729906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICre9ovP_lpoeukuJK3KA82DlIpew9Bm50GHE3iSRHHlT9Th4dA5uTR_giJ2JFYiNSZZlMmV9FtzZN3bvY-jnDMm5qnZPdWtm3VZkUCkugHh09diYpYbKJFdlk-OvDTqvWYoKA2NtSrXlIf2X9M8HZWIWmnrIXmtj1lR_uaUZzkxqEo Sep 13 07:02:27.729906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:02:27.729906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:02:27.729906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:02:27.729906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:02:27.729906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:02:27.729906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:02:27.729906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 81082b2f3a984d09baac046de385ea96 Sep 13 07:02:27.729906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-VolumesActionsTest-282709347 Sep 13 07:02:27.729906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:02:27.729906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:02:27.731277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/81082b2f3a984d09baac046de385ea96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81082b2f3a984d09baac046de385ea96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81082b2f3a984d09baac046de385ea96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_81082b2f3a984d09baac046de385ea96", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:02:27.731277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-VolumesActionsTest-282709347 Sep 13 07:02:27.731277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 81082b2f3a984d09baac046de385ea96 Sep 13 07:02:27.731277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-VolumesActionsTest-282709347 Sep 13 07:02:27.731277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-VolumesActionsTest-282709347-project Sep 13 07:02:27.731277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:02:27.731277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:02:27.731277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 5bd897d855c64ae28ec3f10f69e9e8b2 Sep 13 07:02:27.731277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-VolumesActionsTest-282709347-project Sep 13 07:02:27.731277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:02:27.731277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa could not be found. Sep 13 07:02:27.731277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': '2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa'} Sep 13 07:02:27.732305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:02:27.732305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:02:27.732305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:02:27.732305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:02:27.732305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:02:27.732305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:02:27.732305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:02:27.732305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:02:27.732305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:02:27.732305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:02:27.732305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa could not be found. Sep 13 07:02:27.732305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:02:27.732305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:02:27.732305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:02:27.732305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:02:27.732305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:02:27.732305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:02:27.732305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:02:27.732305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:02:27.732305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:02:27.733423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:02:27.733423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:02:27.733423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:02:27.733423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:02:27.733423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:02:27.733423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:02:27.733423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:02:27.733423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa could not be found. Sep 13 07:02:27.733423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:02:27.733423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:02:27.733423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:02:27.733423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:02:27.733423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:02:27.733423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:02:27.733423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:02:27.733423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:02:27.733423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa could not be found. Sep 13 07:02:27.733423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:02:27.734401 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fb1f1d62-6811-4872-8bbb-f4cc0d35b266 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Returning 404 to user: Instance 2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:02:27.734401 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fb1f1d62-6811-4872-8bbb-f4cc0d35b266 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa" status: 404 len: 111 microversion: 2.1 time: 0.032247 Sep 13 07:02:27.734401 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 107/203] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:27 2022] GET /compute/v2.1/servers/2dbe9afc-05ea-47cc-a373-fb8af7ebc8fa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:02:27.846237 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e904cf0a-edd5-4ec3-8719-3f3029529504 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-9293995", "imageRef": "19a6700e-e153-4bea-87aa-036bfccf0ecd", "flavorRef": "452", "networks": [{"uuid": "f93137cd-66b0-4f09-930d-e6072707a728"}]}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:02:27.913053 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-e904cf0a-edd5-4ec3-8719-3f3029529504 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] validate_networks() for [('f93137cd-66b0-4f09-930d-e6072707a728', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:02:28.102610 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3f7c8010-4242-44b6-a658-dfae6afac999 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:28.103516 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3f7c8010-4242-44b6-a658-dfae6afac999 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:28.119348 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f7c8010-4242-44b6-a658-dfae6afac999 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:28.120045 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f7c8010-4242-44b6-a658-dfae6afac999 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:28.120683 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f7c8010-4242-44b6-a658-dfae6afac999 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:28.121628 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f7c8010-4242-44b6-a658-dfae6afac999 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:28.122440 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f7c8010-4242-44b6-a658-dfae6afac999 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:28.123358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f7c8010-4242-44b6-a658-dfae6afac999 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:28.142955 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-3f7c8010-4242-44b6-a658-dfae6afac999 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] HTTP exception thrown: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. Sep 13 07:02:28.144476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3f7c8010-4242-44b6-a658-dfae6afac999 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Request method failure captured: Sep 13 07:02:28.144476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de HTTP/1.1 Sep 13 07:02:28.144476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:02:28.144476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:02:28.144476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:02:28.144476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:02:28.144476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:02:28.144476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:02:28.144476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:02:28.144476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:02:28.144476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICq71RlDvVABkk4L09BG3wcxYxR4PecCxVDGv1NyIPOQz7jSIiHn_e6Y7zt95fFdM9H5eKsz-TQ2S6BF9WW_OYaxEoqin0hTPozaIKyfrAvinf4z92DfgiWaV4wpua-pXMcSnQUwAbR2dCACIc60CCtpPHgkkBbxeIeDMHEYT2l-5jk Sep 13 07:02:28.144476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:02:28.144476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:02:28.144476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:02:28.144476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:02:28.144476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:02:28.144476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:02:28.144476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 5d415383e1c1471aae5712893d48c2b6 Sep 13 07:02:28.144476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-DeleteServersTestJSON-509853679 Sep 13 07:02:28.144476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:02:28.144476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:02:28.145896 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5d415383e1c1471aae5712893d48c2b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d415383e1c1471aae5712893d48c2b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d415383e1c1471aae5712893d48c2b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5d415383e1c1471aae5712893d48c2b6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:02:28.145896 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-DeleteServersTestJSON-509853679 Sep 13 07:02:28.145896 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 5d415383e1c1471aae5712893d48c2b6 Sep 13 07:02:28.145896 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-DeleteServersTestJSON-509853679 Sep 13 07:02:28.145896 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-DeleteServersTestJSON-509853679-project Sep 13 07:02:28.145896 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:02:28.145896 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:02:28.145896 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 23088396d0ca47c5929690820a3f7e29 Sep 13 07:02:28.145896 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-DeleteServersTestJSON-509853679-project Sep 13 07:02:28.145896 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:02:28.145896 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. Sep 13 07:02:28.145896 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': '2626a298-4f0c-4116-aa68-f1799bd7b8de'} Sep 13 07:02:28.146724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:02:28.146724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:02:28.146724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:02:28.146724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:02:28.146724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:02:28.146724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:02:28.146724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:02:28.146724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:02:28.146724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:02:28.146724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:02:28.146724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. Sep 13 07:02:28.146724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:02:28.146724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:02:28.146724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:02:28.146724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:02:28.146724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:02:28.146724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:02:28.146724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:02:28.146724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:02:28.146724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:02:28.147771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:02:28.147771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 07:02:28.147771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 07:02:28.147771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 07:02:28.147771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 07:02:28.147771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:02:28.147771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:02:28.147771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:02:28.147771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:02:28.147771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. Sep 13 07:02:28.147771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:02:28.147771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:02:28.147771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:02:28.147771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:02:28.147771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:02:28.147771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:02:28.147771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:02:28.147771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:02:28.147771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. Sep 13 07:02:28.147771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:02:28.150521 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3f7c8010-4242-44b6-a658-dfae6afac999 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Returning 404 to user: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:02:28.150521 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3f7c8010-4242-44b6-a658-dfae6afac999 tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 404 len: 111 microversion: 2.1 time: 0.050499 Sep 13 07:02:28.150521 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 108/204] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:02:28 2022] DELETE /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:02:28.156793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c48a4950-8f7e-4b4d-8cf9-e1d340f410fd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:28.157498 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c48a4950-8f7e-4b4d-8cf9-e1d340f410fd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] [instance: 2626a298-4f0c-4116-aa68-f1799bd7b8de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:28.165453 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c48a4950-8f7e-4b4d-8cf9-e1d340f410fd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:28.166242 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c48a4950-8f7e-4b4d-8cf9-e1d340f410fd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:28.166667 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c48a4950-8f7e-4b4d-8cf9-e1d340f410fd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:28.167685 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c48a4950-8f7e-4b4d-8cf9-e1d340f410fd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:28.168305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c48a4950-8f7e-4b4d-8cf9-e1d340f410fd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:28.168527 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c48a4950-8f7e-4b4d-8cf9-e1d340f410fd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:28.187781 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-c48a4950-8f7e-4b4d-8cf9-e1d340f410fd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] HTTP exception thrown: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. Sep 13 07:02:28.189793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c48a4950-8f7e-4b4d-8cf9-e1d340f410fd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Request method failure captured: Sep 13 07:02:28.189793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de HTTP/1.1 Sep 13 07:02:28.189793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:02:28.189793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:02:28.189793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:02:28.189793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:02:28.189793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:02:28.189793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:02:28.189793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:02:28.189793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:02:28.189793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICq71RlDvVABkk4L09BG3wcxYxR4PecCxVDGv1NyIPOQz7jSIiHn_e6Y7zt95fFdM9H5eKsz-TQ2S6BF9WW_OYaxEoqin0hTPozaIKyfrAvinf4z92DfgiWaV4wpua-pXMcSnQUwAbR2dCACIc60CCtpPHgkkBbxeIeDMHEYT2l-5jk Sep 13 07:02:28.189793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:02:28.189793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:02:28.189793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:02:28.189793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:02:28.189793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:02:28.189793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:02:28.189793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 5d415383e1c1471aae5712893d48c2b6 Sep 13 07:02:28.189793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-DeleteServersTestJSON-509853679 Sep 13 07:02:28.189793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:02:28.189793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:02:28.191079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5d415383e1c1471aae5712893d48c2b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d415383e1c1471aae5712893d48c2b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d415383e1c1471aae5712893d48c2b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5d415383e1c1471aae5712893d48c2b6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:02:28.191079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-DeleteServersTestJSON-509853679 Sep 13 07:02:28.191079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 5d415383e1c1471aae5712893d48c2b6 Sep 13 07:02:28.191079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-DeleteServersTestJSON-509853679 Sep 13 07:02:28.191079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-DeleteServersTestJSON-509853679-project Sep 13 07:02:28.191079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:02:28.191079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:02:28.191079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 23088396d0ca47c5929690820a3f7e29 Sep 13 07:02:28.191079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-DeleteServersTestJSON-509853679-project Sep 13 07:02:28.191079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:02:28.191079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. Sep 13 07:02:28.191079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': '2626a298-4f0c-4116-aa68-f1799bd7b8de'} Sep 13 07:02:28.191785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:02:28.191785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:02:28.191785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:02:28.191785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:02:28.191785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:02:28.191785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:02:28.191785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:02:28.191785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:02:28.191785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:02:28.191785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:02:28.191785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. Sep 13 07:02:28.191785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:02:28.191785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:02:28.191785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:02:28.191785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:02:28.191785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:02:28.191785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:02:28.191785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:02:28.191785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:02:28.191785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:02:28.192904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:02:28.192904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:02:28.192904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:02:28.192904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:02:28.192904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:02:28.192904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:02:28.192904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:02:28.192904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. Sep 13 07:02:28.192904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:02:28.192904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:02:28.192904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:02:28.192904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:02:28.192904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:02:28.192904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:02:28.192904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:02:28.192904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:02:28.192904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. Sep 13 07:02:28.192904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:02:28.194822 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c48a4950-8f7e-4b4d-8cf9-e1d340f410fd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] Returning 404 to user: Instance 2626a298-4f0c-4116-aa68-f1799bd7b8de could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:02:28.194822 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c48a4950-8f7e-4b4d-8cf9-e1d340f410fd tempest-DeleteServersTestJSON-509853679 tempest-DeleteServersTestJSON-509853679-project] 10.222.0.25 "GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de" status: 404 len: 111 microversion: 2.1 time: 0.039085 Sep 13 07:02:28.194822 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 109/205] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:28 2022] GET /compute/v2.1/servers/2626a298-4f0c-4116-aa68-f1799bd7b8de => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 07:02:28.329778 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-e904cf0a-edd5-4ec3-8719-3f3029529504 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:02:28.330729 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-e904cf0a-edd5-4ec3-8719-3f3029529504 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:02:28.331339 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-e904cf0a-edd5-4ec3-8719-3f3029529504 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:02:28.331878 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-e904cf0a-edd5-4ec3-8719-3f3029529504 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:02:28.332706 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-e904cf0a-edd5-4ec3-8719-3f3029529504 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:02:28.347587 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e904cf0a-edd5-4ec3-8719-3f3029529504 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:28.348091 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e904cf0a-edd5-4ec3-8719-3f3029529504 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:28.348698 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e904cf0a-edd5-4ec3-8719-3f3029529504 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:28.349454 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e904cf0a-edd5-4ec3-8719-3f3029529504 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:28.349862 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e904cf0a-edd5-4ec3-8719-3f3029529504 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:28.350302 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e904cf0a-edd5-4ec3-8719-3f3029529504 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:28.369811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-e904cf0a-edd5-4ec3-8719-3f3029529504 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Getting quotas for project 81082b2f3a984d09baac046de385ea96. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:02:28.374292 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-e904cf0a-edd5-4ec3-8719-3f3029529504 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Getting quotas for user 5bd897d855c64ae28ec3f10f69e9e8b2 and project 81082b2f3a984d09baac046de385ea96. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:02:28.386186 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e904cf0a-edd5-4ec3-8719-3f3029529504 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:02:28.389899 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e904cf0a-edd5-4ec3-8719-3f3029529504 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 8dea75f2-305a-4f57-b1b7-49603248c250] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='19a6700e-e153-4bea-87aa-036bfccf0ecd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:02:28.441412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e904cf0a-edd5-4ec3-8719-3f3029529504 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598942 Sep 13 07:02:28.441985 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 97/206] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Sep 13 07:02:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 07:02:28.453630 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8de3b600-9441-43b2-b9a6-7001dc677960 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:28.454408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8de3b600-9441-43b2-b9a6-7001dc677960 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 8dea75f2-305a-4f57-b1b7-49603248c250] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:28.487559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0af0d92c-fdd4-4153-9046-07adf03ec4a5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:28.490944 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0af0d92c-fdd4-4153-9046-07adf03ec4a5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:28.493040 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:28.499127 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0af0d92c-fdd4-4153-9046-07adf03ec4a5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:28.499622 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0af0d92c-fdd4-4153-9046-07adf03ec4a5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:28.500055 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0af0d92c-fdd4-4153-9046-07adf03ec4a5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:28.500937 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0af0d92c-fdd4-4153-9046-07adf03ec4a5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:28.501560 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0af0d92c-fdd4-4153-9046-07adf03ec4a5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:28.502198 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0af0d92c-fdd4-4153-9046-07adf03ec4a5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:28.521903 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8de3b600-9441-43b2-b9a6-7001dc677960 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:28.529973 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8de3b600-9441-43b2-b9a6-7001dc677960 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250" status: 200 len: 1211 microversion: 2.1 time: 0.080166 Sep 13 07:02:28.531613 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 110/207] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:28 2022] GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250 => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:28.661636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0af0d92c-fdd4-4153-9046-07adf03ec4a5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:28.670646 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0af0d92c-fdd4-4153-9046-07adf03ec4a5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.187313 Sep 13 07:02:28.671807 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 98/208] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:28 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:29.553896 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9a63b734-d8c1-4fd5-b856-45db9acf1bee tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:29.554484 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9a63b734-d8c1-4fd5-b856-45db9acf1bee tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 8dea75f2-305a-4f57-b1b7-49603248c250] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:29.556752 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:29.562899 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9a63b734-d8c1-4fd5-b856-45db9acf1bee tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:29.563389 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9a63b734-d8c1-4fd5-b856-45db9acf1bee tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:29.563842 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9a63b734-d8c1-4fd5-b856-45db9acf1bee tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:29.564670 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9a63b734-d8c1-4fd5-b856-45db9acf1bee tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:29.565118 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9a63b734-d8c1-4fd5-b856-45db9acf1bee tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:29.565535 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9a63b734-d8c1-4fd5-b856-45db9acf1bee tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:29.635041 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9a63b734-d8c1-4fd5-b856-45db9acf1bee tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:29.643403 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9a63b734-d8c1-4fd5-b856-45db9acf1bee tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250" status: 200 len: 1215 microversion: 2.1 time: 0.093591 Sep 13 07:02:29.643899 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 111/209] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:29 2022] GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250 => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:29.692783 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b6418e2f-7315-4296-82c4-c2994d188b07 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:29.693446 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b6418e2f-7315-4296-82c4-c2994d188b07 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:29.700560 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b6418e2f-7315-4296-82c4-c2994d188b07 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:29.701047 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b6418e2f-7315-4296-82c4-c2994d188b07 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:29.701482 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b6418e2f-7315-4296-82c4-c2994d188b07 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:29.702215 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b6418e2f-7315-4296-82c4-c2994d188b07 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:29.702667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b6418e2f-7315-4296-82c4-c2994d188b07 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:29.703082 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b6418e2f-7315-4296-82c4-c2994d188b07 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:29.842252 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b6418e2f-7315-4296-82c4-c2994d188b07 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:29.851399 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b6418e2f-7315-4296-82c4-c2994d188b07 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.162140 Sep 13 07:02:29.852531 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 99/210] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:29 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:30.666198 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2b1232b5-0535-4dd4-a968-547a9939b6cf tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:30.666835 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2b1232b5-0535-4dd4-a968-547a9939b6cf tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 8dea75f2-305a-4f57-b1b7-49603248c250] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:30.675043 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b1232b5-0535-4dd4-a968-547a9939b6cf tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:30.675562 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b1232b5-0535-4dd4-a968-547a9939b6cf tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:30.675955 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b1232b5-0535-4dd4-a968-547a9939b6cf tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:30.676634 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b1232b5-0535-4dd4-a968-547a9939b6cf tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:30.677075 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b1232b5-0535-4dd4-a968-547a9939b6cf tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:30.677488 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b1232b5-0535-4dd4-a968-547a9939b6cf tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:30.746248 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2b1232b5-0535-4dd4-a968-547a9939b6cf tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:30.755596 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2b1232b5-0535-4dd4-a968-547a9939b6cf tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250" status: 200 len: 1215 microversion: 2.1 time: 0.093265 Sep 13 07:02:30.756694 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 112/211] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:30 2022] GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250 => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:30.876294 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-694019ed-4724-4d63-9c18-9561c1f67431 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:30.877426 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-694019ed-4724-4d63-9c18-9561c1f67431 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:30.889999 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-694019ed-4724-4d63-9c18-9561c1f67431 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:30.891256 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-694019ed-4724-4d63-9c18-9561c1f67431 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:30.891698 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-694019ed-4724-4d63-9c18-9561c1f67431 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:30.892377 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-694019ed-4724-4d63-9c18-9561c1f67431 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:30.893014 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-694019ed-4724-4d63-9c18-9561c1f67431 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:30.893403 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-694019ed-4724-4d63-9c18-9561c1f67431 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:31.345560 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-694019ed-4724-4d63-9c18-9561c1f67431 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:31.355705 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-694019ed-4724-4d63-9c18-9561c1f67431 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.484147 Sep 13 07:02:31.356643 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 100/212] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:30 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:31.781979 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4368c76c-5ca0-4ec0-9652-04d8a56fa282 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:31.782705 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4368c76c-5ca0-4ec0-9652-04d8a56fa282 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 8dea75f2-305a-4f57-b1b7-49603248c250] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:31.789301 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4368c76c-5ca0-4ec0-9652-04d8a56fa282 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:31.789876 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4368c76c-5ca0-4ec0-9652-04d8a56fa282 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:31.790451 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4368c76c-5ca0-4ec0-9652-04d8a56fa282 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:31.791230 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4368c76c-5ca0-4ec0-9652-04d8a56fa282 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:31.791684 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4368c76c-5ca0-4ec0-9652-04d8a56fa282 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:31.792468 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4368c76c-5ca0-4ec0-9652-04d8a56fa282 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:31.974011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4368c76c-5ca0-4ec0-9652-04d8a56fa282 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:31.982197 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4368c76c-5ca0-4ec0-9652-04d8a56fa282 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250" status: 200 len: 1263 microversion: 2.1 time: 0.204847 Sep 13 07:02:31.982857 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 113/213] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:31 2022] GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250 => generated 1263 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:32.379470 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-845e5fdb-1fa3-48a7-93aa-03fef27d3be2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:32.380078 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-845e5fdb-1fa3-48a7-93aa-03fef27d3be2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:32.391864 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-845e5fdb-1fa3-48a7-93aa-03fef27d3be2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:32.392546 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-845e5fdb-1fa3-48a7-93aa-03fef27d3be2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:32.393204 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-845e5fdb-1fa3-48a7-93aa-03fef27d3be2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:32.394172 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-845e5fdb-1fa3-48a7-93aa-03fef27d3be2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:32.394733 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-845e5fdb-1fa3-48a7-93aa-03fef27d3be2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:32.395365 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-845e5fdb-1fa3-48a7-93aa-03fef27d3be2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:32.598227 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-845e5fdb-1fa3-48a7-93aa-03fef27d3be2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:32.609219 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-845e5fdb-1fa3-48a7-93aa-03fef27d3be2 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.234484 Sep 13 07:02:32.613700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 101/214] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:32 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:33.008293 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0097074e-9a2a-42c4-acaa-710137d655ea tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:33.009603 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0097074e-9a2a-42c4-acaa-710137d655ea tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 8dea75f2-305a-4f57-b1b7-49603248c250] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:33.019552 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0097074e-9a2a-42c4-acaa-710137d655ea tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:33.020227 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0097074e-9a2a-42c4-acaa-710137d655ea tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:33.020861 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0097074e-9a2a-42c4-acaa-710137d655ea tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:33.022349 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0097074e-9a2a-42c4-acaa-710137d655ea tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:33.022997 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0097074e-9a2a-42c4-acaa-710137d655ea tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:33.023591 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0097074e-9a2a-42c4-acaa-710137d655ea tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:33.178631 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0097074e-9a2a-42c4-acaa-710137d655ea tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:33.188831 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0097074e-9a2a-42c4-acaa-710137d655ea tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250" status: 200 len: 1281 microversion: 2.1 time: 0.185558 Sep 13 07:02:33.191308 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 114/215] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:33 2022] GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250 => generated 1281 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:33.636284 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f66e4548-5e96-4abd-8a6b-49343d20a860 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:33.638123 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f66e4548-5e96-4abd-8a6b-49343d20a860 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:33.664287 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f66e4548-5e96-4abd-8a6b-49343d20a860 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:33.665684 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f66e4548-5e96-4abd-8a6b-49343d20a860 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:33.668010 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f66e4548-5e96-4abd-8a6b-49343d20a860 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:33.670000 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f66e4548-5e96-4abd-8a6b-49343d20a860 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:33.670688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f66e4548-5e96-4abd-8a6b-49343d20a860 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:33.671776 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f66e4548-5e96-4abd-8a6b-49343d20a860 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:33.925286 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f66e4548-5e96-4abd-8a6b-49343d20a860 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:33.940907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f66e4548-5e96-4abd-8a6b-49343d20a860 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.306577 Sep 13 07:02:33.942792 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 102/216] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:33 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:34.222914 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0c19624f-8f48-4fb2-92e7-babf67261381 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:34.224104 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0c19624f-8f48-4fb2-92e7-babf67261381 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 8dea75f2-305a-4f57-b1b7-49603248c250] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:34.232593 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0c19624f-8f48-4fb2-92e7-babf67261381 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:34.233785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0c19624f-8f48-4fb2-92e7-babf67261381 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:34.234713 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0c19624f-8f48-4fb2-92e7-babf67261381 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:34.235704 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0c19624f-8f48-4fb2-92e7-babf67261381 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:34.236552 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0c19624f-8f48-4fb2-92e7-babf67261381 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:34.237253 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0c19624f-8f48-4fb2-92e7-babf67261381 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:34.418620 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0c19624f-8f48-4fb2-92e7-babf67261381 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:34.427911 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0c19624f-8f48-4fb2-92e7-babf67261381 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250" status: 200 len: 1311 microversion: 2.1 time: 0.210373 Sep 13 07:02:34.429336 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 115/217] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:34 2022] GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250 => generated 1311 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:34.931212 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-0ae348a4-5fe8-4ab4-af56-322783b6d045 req-a6d0cfb4-ada5-4a30-8ce6-4ccef717b42d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dea75f2-305a-4f57-b1b7-49603248c250", "tag": "8d07913a-b503-4a3e-86f2-3ba8a8783465"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:02:34.942386 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-0ae348a4-5fe8-4ab4-af56-322783b6d045 req-a6d0cfb4-ada5-4a30-8ce6-4ccef717b42d service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:34.942940 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-0ae348a4-5fe8-4ab4-af56-322783b6d045 req-a6d0cfb4-ada5-4a30-8ce6-4ccef717b42d service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:34.943412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-0ae348a4-5fe8-4ab4-af56-322783b6d045 req-a6d0cfb4-ada5-4a30-8ce6-4ccef717b42d service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:34.955586 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-0ae348a4-5fe8-4ab4-af56-322783b6d045 req-a6d0cfb4-ada5-4a30-8ce6-4ccef717b42d service nova] Creating event network-changed:8d07913a-b503-4a3e-86f2-3ba8a8783465 for instance 8dea75f2-305a-4f57-b1b7-49603248c250 on hv-cinder-85694 Sep 13 07:02:34.962711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-0ae348a4-5fe8-4ab4-af56-322783b6d045 req-a6d0cfb4-ada5-4a30-8ce6-4ccef717b42d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035528 Sep 13 07:02:34.963672 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 103/218] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:02:34.968534 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8567ca90-fc77-433b-bb5b-dd4714e5f5b8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:34.969325 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8567ca90-fc77-433b-bb5b-dd4714e5f5b8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:34.980213 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8567ca90-fc77-433b-bb5b-dd4714e5f5b8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:34.980853 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8567ca90-fc77-433b-bb5b-dd4714e5f5b8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:34.981282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8567ca90-fc77-433b-bb5b-dd4714e5f5b8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:34.983102 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8567ca90-fc77-433b-bb5b-dd4714e5f5b8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:34.983886 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8567ca90-fc77-433b-bb5b-dd4714e5f5b8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:34.984498 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8567ca90-fc77-433b-bb5b-dd4714e5f5b8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:35.178295 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8567ca90-fc77-433b-bb5b-dd4714e5f5b8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:35.184936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8567ca90-fc77-433b-bb5b-dd4714e5f5b8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1518 microversion: 2.1 time: 0.221565 Sep 13 07:02:35.189429 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 116/219] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:34 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1518 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:35.478497 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2e180435-66e2-4167-b38a-a6b7c1a90cc7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:35.478497 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2e180435-66e2-4167-b38a-a6b7c1a90cc7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 8dea75f2-305a-4f57-b1b7-49603248c250] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:35.488340 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2e180435-66e2-4167-b38a-a6b7c1a90cc7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:35.488820 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2e180435-66e2-4167-b38a-a6b7c1a90cc7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:35.489242 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2e180435-66e2-4167-b38a-a6b7c1a90cc7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:35.489934 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2e180435-66e2-4167-b38a-a6b7c1a90cc7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:35.490408 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2e180435-66e2-4167-b38a-a6b7c1a90cc7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:35.490820 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2e180435-66e2-4167-b38a-a6b7c1a90cc7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:35.750559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2e180435-66e2-4167-b38a-a6b7c1a90cc7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:35.760480 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2e180435-66e2-4167-b38a-a6b7c1a90cc7 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250" status: 200 len: 1311 microversion: 2.1 time: 0.287949 Sep 13 07:02:35.761482 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 104/220] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:35 2022] GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250 => generated 1311 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:36.208824 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-01719240-bde0-4afe-a98c-85fc390cb0b7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:36.210228 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-01719240-bde0-4afe-a98c-85fc390cb0b7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:36.216794 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-01719240-bde0-4afe-a98c-85fc390cb0b7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:36.217282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-01719240-bde0-4afe-a98c-85fc390cb0b7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:36.217739 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-01719240-bde0-4afe-a98c-85fc390cb0b7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:36.218517 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-01719240-bde0-4afe-a98c-85fc390cb0b7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:36.218941 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-01719240-bde0-4afe-a98c-85fc390cb0b7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:36.219494 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-01719240-bde0-4afe-a98c-85fc390cb0b7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:36.362950 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-01719240-bde0-4afe-a98c-85fc390cb0b7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:36.372258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-01719240-bde0-4afe-a98c-85fc390cb0b7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1498 microversion: 2.1 time: 0.168095 Sep 13 07:02:36.372844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 117/221] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:36 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1498 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:36.394157 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f5ce84cc-268d-481a-afe5-7ca8b81e4580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:36.394799 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f5ce84cc-268d-481a-afe5-7ca8b81e4580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:36.401264 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5ce84cc-268d-481a-afe5-7ca8b81e4580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:36.401555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5ce84cc-268d-481a-afe5-7ca8b81e4580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:36.401984 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5ce84cc-268d-481a-afe5-7ca8b81e4580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:36.402694 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5ce84cc-268d-481a-afe5-7ca8b81e4580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:36.403108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5ce84cc-268d-481a-afe5-7ca8b81e4580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:36.403550 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5ce84cc-268d-481a-afe5-7ca8b81e4580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:36.531957 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f5ce84cc-268d-481a-afe5-7ca8b81e4580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:36.539920 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f5ce84cc-268d-481a-afe5-7ca8b81e4580 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1513 microversion: 2.1 time: 0.149635 Sep 13 07:02:36.540699 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 105/222] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:36 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:36.783477 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-db4c1a7d-b35a-4a1a-bdaf-dd7edd3d1ede tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:36.784451 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-db4c1a7d-b35a-4a1a-bdaf-dd7edd3d1ede tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 8dea75f2-305a-4f57-b1b7-49603248c250] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:36.791752 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-db4c1a7d-b35a-4a1a-bdaf-dd7edd3d1ede tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:36.792235 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-db4c1a7d-b35a-4a1a-bdaf-dd7edd3d1ede tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:36.792914 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-db4c1a7d-b35a-4a1a-bdaf-dd7edd3d1ede tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:36.793825 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-db4c1a7d-b35a-4a1a-bdaf-dd7edd3d1ede tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:36.794426 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-db4c1a7d-b35a-4a1a-bdaf-dd7edd3d1ede tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:36.794988 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-db4c1a7d-b35a-4a1a-bdaf-dd7edd3d1ede tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:36.983376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-db4c1a7d-b35a-4a1a-bdaf-dd7edd3d1ede tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:36.992146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-db4c1a7d-b35a-4a1a-bdaf-dd7edd3d1ede tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250" status: 200 len: 1311 microversion: 2.1 time: 0.212684 Sep 13 07:02:36.993147 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 118/223] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:36 2022] GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250 => generated 1311 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:38.018032 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3c6e2a63-4179-417d-9444-e1b135a9e4d9 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:38.020037 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3c6e2a63-4179-417d-9444-e1b135a9e4d9 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 8dea75f2-305a-4f57-b1b7-49603248c250] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:38.046319 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3c6e2a63-4179-417d-9444-e1b135a9e4d9 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:38.046828 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3c6e2a63-4179-417d-9444-e1b135a9e4d9 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:38.047309 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3c6e2a63-4179-417d-9444-e1b135a9e4d9 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:38.048039 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3c6e2a63-4179-417d-9444-e1b135a9e4d9 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:38.048485 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3c6e2a63-4179-417d-9444-e1b135a9e4d9 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:38.048897 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3c6e2a63-4179-417d-9444-e1b135a9e4d9 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:38.063619 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9c2d0b6c-9c46-408b-99b9-6b27389f5758 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:02:38.073979 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9c2d0b6c-9c46-408b-99b9-6b27389f5758 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:38.080017 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c2d0b6c-9c46-408b-99b9-6b27389f5758 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:38.080736 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c2d0b6c-9c46-408b-99b9-6b27389f5758 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:38.081325 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c2d0b6c-9c46-408b-99b9-6b27389f5758 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:38.082388 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c2d0b6c-9c46-408b-99b9-6b27389f5758 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:38.084457 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c2d0b6c-9c46-408b-99b9-6b27389f5758 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:38.085071 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c2d0b6c-9c46-408b-99b9-6b27389f5758 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:38.148969 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-9c2d0b6c-9c46-408b-99b9-6b27389f5758 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lazy-loading 'flavor' on Instance uuid 8082cb10-169b-478f-9b71-7680fe245559 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:02:38.217119 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3c6e2a63-4179-417d-9444-e1b135a9e4d9 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:38.226211 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3c6e2a63-4179-417d-9444-e1b135a9e4d9 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250" status: 200 len: 1311 microversion: 2.1 time: 0.214134 Sep 13 07:02:38.226792 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 106/224] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:38 2022] GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250 => generated 1311 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:38.253080 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9c2d0b6c-9c46-408b-99b9-6b27389f5758 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "POST /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559/action" status: 200 len: 32 microversion: 2.1 time: 0.195459 Sep 13 07:02:38.253793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 119/225] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Sep 13 07:02:38 2022] POST /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559/action => generated 32 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 07:02:38.264839 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-83c26a55-b69f-4138-b1eb-bb5f15c7a542 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:38.265499 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-83c26a55-b69f-4138-b1eb-bb5f15c7a542 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:38.273945 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-83c26a55-b69f-4138-b1eb-bb5f15c7a542 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:38.274486 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-83c26a55-b69f-4138-b1eb-bb5f15c7a542 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:38.275069 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-83c26a55-b69f-4138-b1eb-bb5f15c7a542 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:38.278002 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-83c26a55-b69f-4138-b1eb-bb5f15c7a542 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:38.278532 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-83c26a55-b69f-4138-b1eb-bb5f15c7a542 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:38.279613 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-83c26a55-b69f-4138-b1eb-bb5f15c7a542 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:38.360752 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:38.381620 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=6 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:38.467215 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-83c26a55-b69f-4138-b1eb-bb5f15c7a542 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:38.476459 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-83c26a55-b69f-4138-b1eb-bb5f15c7a542 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.216630 Sep 13 07:02:38.477046 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 107/226] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:38 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:39.247594 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:39.252015 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6c76068b-25cf-441a-9c7f-87dd6b93837a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:39.252715 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6c76068b-25cf-441a-9c7f-87dd6b93837a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 8dea75f2-305a-4f57-b1b7-49603248c250] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:39.262259 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c76068b-25cf-441a-9c7f-87dd6b93837a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:39.262582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c76068b-25cf-441a-9c7f-87dd6b93837a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:39.269463 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c76068b-25cf-441a-9c7f-87dd6b93837a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:39.270296 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c76068b-25cf-441a-9c7f-87dd6b93837a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:39.270758 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c76068b-25cf-441a-9c7f-87dd6b93837a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:39.271153 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c76068b-25cf-441a-9c7f-87dd6b93837a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:39.501754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-81c50f8b-1c35-4943-8c0b-0b5b84397c33 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:39.503837 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-81c50f8b-1c35-4943-8c0b-0b5b84397c33 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:39.519046 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-81c50f8b-1c35-4943-8c0b-0b5b84397c33 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:39.519549 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-81c50f8b-1c35-4943-8c0b-0b5b84397c33 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:39.519979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-81c50f8b-1c35-4943-8c0b-0b5b84397c33 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:39.520929 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-81c50f8b-1c35-4943-8c0b-0b5b84397c33 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:39.526270 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-81c50f8b-1c35-4943-8c0b-0b5b84397c33 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:39.526849 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-81c50f8b-1c35-4943-8c0b-0b5b84397c33 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:39.780832 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6c76068b-25cf-441a-9c7f-87dd6b93837a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:39.791746 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6c76068b-25cf-441a-9c7f-87dd6b93837a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250" status: 200 len: 1311 microversion: 2.1 time: 0.545110 Sep 13 07:02:39.793122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 120/227] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:39 2022] GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250 => generated 1311 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:39.825984 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-81c50f8b-1c35-4943-8c0b-0b5b84397c33 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:39.837683 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-81c50f8b-1c35-4943-8c0b-0b5b84397c33 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.337146 Sep 13 07:02:39.846228 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 108/228] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:39 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:02:40.816891 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2bc9733b-229c-4476-b53f-c4399a169dda tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:40.817758 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2bc9733b-229c-4476-b53f-c4399a169dda tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 8dea75f2-305a-4f57-b1b7-49603248c250] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:40.823892 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2bc9733b-229c-4476-b53f-c4399a169dda tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:40.824567 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2bc9733b-229c-4476-b53f-c4399a169dda tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:40.825293 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2bc9733b-229c-4476-b53f-c4399a169dda tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:40.826654 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2bc9733b-229c-4476-b53f-c4399a169dda tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:40.827254 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2bc9733b-229c-4476-b53f-c4399a169dda tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:40.828089 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2bc9733b-229c-4476-b53f-c4399a169dda tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:40.874116 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1e77c361-ab99-4002-8f56-a9dc83b95c61 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:40.877364 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1e77c361-ab99-4002-8f56-a9dc83b95c61 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:40.889555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1e77c361-ab99-4002-8f56-a9dc83b95c61 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:40.890483 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1e77c361-ab99-4002-8f56-a9dc83b95c61 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:40.891342 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1e77c361-ab99-4002-8f56-a9dc83b95c61 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:40.892946 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1e77c361-ab99-4002-8f56-a9dc83b95c61 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:40.893699 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1e77c361-ab99-4002-8f56-a9dc83b95c61 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:40.894515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1e77c361-ab99-4002-8f56-a9dc83b95c61 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:41.094299 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2bc9733b-229c-4476-b53f-c4399a169dda tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:41.107302 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2bc9733b-229c-4476-b53f-c4399a169dda tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250" status: 200 len: 1311 microversion: 2.1 time: 0.294061 Sep 13 07:02:41.123982 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 121/229] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:40 2022] GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250 => generated 1311 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:41.153713 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-d5404a00-f6c3-43f5-a1ad-70b690a4df03 req-5c8eb93e-57e5-44c2-98ff-670a1bacd158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dea75f2-305a-4f57-b1b7-49603248c250", "name": "network-vif-plugged", "status": "completed", "tag": "8d07913a-b503-4a3e-86f2-3ba8a8783465"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:02:41.179217 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1e77c361-ab99-4002-8f56-a9dc83b95c61 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:41.179602 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d5404a00-f6c3-43f5-a1ad-70b690a4df03 req-5c8eb93e-57e5-44c2-98ff-670a1bacd158 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:41.180160 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d5404a00-f6c3-43f5-a1ad-70b690a4df03 req-5c8eb93e-57e5-44c2-98ff-670a1bacd158 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:41.183864 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d5404a00-f6c3-43f5-a1ad-70b690a4df03 req-5c8eb93e-57e5-44c2-98ff-670a1bacd158 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:41.188479 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1e77c361-ab99-4002-8f56-a9dc83b95c61 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.327282 Sep 13 07:02:41.199067 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 109/230] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:40 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:41.217939 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-d5404a00-f6c3-43f5-a1ad-70b690a4df03 req-5c8eb93e-57e5-44c2-98ff-670a1bacd158 service nova] Creating event network-vif-plugged:8d07913a-b503-4a3e-86f2-3ba8a8783465 for instance 8dea75f2-305a-4f57-b1b7-49603248c250 on hv-cinder-85694 Sep 13 07:02:41.231151 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-d5404a00-f6c3-43f5-a1ad-70b690a4df03 req-5c8eb93e-57e5-44c2-98ff-670a1bacd158 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081001 Sep 13 07:02:41.232033 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 122/231] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:02:42.135500 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f3ce112f-ada4-4e07-b527-9efda6d37321 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:42.136255 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f3ce112f-ada4-4e07-b527-9efda6d37321 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 8dea75f2-305a-4f57-b1b7-49603248c250] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:42.147677 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3ce112f-ada4-4e07-b527-9efda6d37321 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:42.148292 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3ce112f-ada4-4e07-b527-9efda6d37321 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:42.148809 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3ce112f-ada4-4e07-b527-9efda6d37321 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:42.149514 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3ce112f-ada4-4e07-b527-9efda6d37321 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:42.150673 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3ce112f-ada4-4e07-b527-9efda6d37321 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:42.151945 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3ce112f-ada4-4e07-b527-9efda6d37321 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:42.216648 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-70d9e39b-cc32-4a71-9776-c4615dfa192e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:42.218020 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-70d9e39b-cc32-4a71-9776-c4615dfa192e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:42.227644 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-70d9e39b-cc32-4a71-9776-c4615dfa192e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:42.228433 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-70d9e39b-cc32-4a71-9776-c4615dfa192e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:42.229272 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-70d9e39b-cc32-4a71-9776-c4615dfa192e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:42.231730 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-70d9e39b-cc32-4a71-9776-c4615dfa192e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:42.232768 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-70d9e39b-cc32-4a71-9776-c4615dfa192e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:42.233610 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-70d9e39b-cc32-4a71-9776-c4615dfa192e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:42.382223 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f3ce112f-ada4-4e07-b527-9efda6d37321 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:42.424170 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f3ce112f-ada4-4e07-b527-9efda6d37321 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250" status: 200 len: 1311 microversion: 2.1 time: 0.287984 Sep 13 07:02:42.424170 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 110/232] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:42 2022] GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250 => generated 1311 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:42.484767 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-70d9e39b-cc32-4a71-9776-c4615dfa192e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:42.495077 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-70d9e39b-cc32-4a71-9776-c4615dfa192e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.284750 Sep 13 07:02:42.496340 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 123/233] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:42 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:02:43.445776 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5a5e4027-1862-4775-9cd0-dd61fc51408d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:43.446402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5a5e4027-1862-4775-9cd0-dd61fc51408d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 8dea75f2-305a-4f57-b1b7-49603248c250] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:43.459161 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5a5e4027-1862-4775-9cd0-dd61fc51408d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:43.460034 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5a5e4027-1862-4775-9cd0-dd61fc51408d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:43.460679 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5a5e4027-1862-4775-9cd0-dd61fc51408d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:43.461897 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5a5e4027-1862-4775-9cd0-dd61fc51408d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:43.462465 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5a5e4027-1862-4775-9cd0-dd61fc51408d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:43.462988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5a5e4027-1862-4775-9cd0-dd61fc51408d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:43.520174 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0dd73dc1-2cdf-4278-8792-d64ecdc80510 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:43.521413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0dd73dc1-2cdf-4278-8792-d64ecdc80510 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:43.532719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0dd73dc1-2cdf-4278-8792-d64ecdc80510 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:43.533718 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0dd73dc1-2cdf-4278-8792-d64ecdc80510 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:43.534202 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0dd73dc1-2cdf-4278-8792-d64ecdc80510 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:43.534932 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0dd73dc1-2cdf-4278-8792-d64ecdc80510 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:43.538356 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0dd73dc1-2cdf-4278-8792-d64ecdc80510 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:43.540210 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0dd73dc1-2cdf-4278-8792-d64ecdc80510 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:43.593080 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:43.821197 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5a5e4027-1862-4775-9cd0-dd61fc51408d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:43.846846 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0dd73dc1-2cdf-4278-8792-d64ecdc80510 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:43.848689 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5a5e4027-1862-4775-9cd0-dd61fc51408d tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250" status: 200 len: 1311 microversion: 2.1 time: 0.407806 Sep 13 07:02:43.850568 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 111/234] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:43 2022] GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250 => generated 1311 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:43.870487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0dd73dc1-2cdf-4278-8792-d64ecdc80510 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.355434 Sep 13 07:02:43.872642 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 124/235] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:43 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:44.881802 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-739830c3-81d1-4d68-babb-01ee0766deec tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:44.884535 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-739830c3-81d1-4d68-babb-01ee0766deec tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 8dea75f2-305a-4f57-b1b7-49603248c250] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:44.896351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dac41641-e639-470e-b83b-9253f3df763e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:44.897303 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-dac41641-e639-470e-b83b-9253f3df763e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:44.905758 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dac41641-e639-470e-b83b-9253f3df763e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:44.910002 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dac41641-e639-470e-b83b-9253f3df763e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:44.911295 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dac41641-e639-470e-b83b-9253f3df763e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:44.913742 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dac41641-e639-470e-b83b-9253f3df763e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:44.914789 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-739830c3-81d1-4d68-babb-01ee0766deec tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:44.915493 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dac41641-e639-470e-b83b-9253f3df763e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:44.916138 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dac41641-e639-470e-b83b-9253f3df763e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:44.920532 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-739830c3-81d1-4d68-babb-01ee0766deec tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:44.921442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-739830c3-81d1-4d68-babb-01ee0766deec tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:44.922679 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-739830c3-81d1-4d68-babb-01ee0766deec tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:44.923284 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-739830c3-81d1-4d68-babb-01ee0766deec tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:44.923832 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-739830c3-81d1-4d68-babb-01ee0766deec tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:45.304221 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-dac41641-e639-470e-b83b-9253f3df763e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:45.327262 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dac41641-e639-470e-b83b-9253f3df763e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.435616 Sep 13 07:02:45.331972 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 125/236] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:44 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:45.342457 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-739830c3-81d1-4d68-babb-01ee0766deec tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:45.356028 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-739830c3-81d1-4d68-babb-01ee0766deec tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250" status: 200 len: 1496 microversion: 2.1 time: 0.486465 Sep 13 07:02:45.356634 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 112/237] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:44 2022] GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250 => generated 1496 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:46.355134 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e7cc354f-1ecc-43a2-9cfe-98378a8ff499 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:46.355776 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e7cc354f-1ecc-43a2-9cfe-98378a8ff499 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:46.367746 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7cc354f-1ecc-43a2-9cfe-98378a8ff499 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:46.370136 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7cc354f-1ecc-43a2-9cfe-98378a8ff499 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:46.371286 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7cc354f-1ecc-43a2-9cfe-98378a8ff499 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:46.373684 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7cc354f-1ecc-43a2-9cfe-98378a8ff499 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:46.374378 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7cc354f-1ecc-43a2-9cfe-98378a8ff499 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:46.376856 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7cc354f-1ecc-43a2-9cfe-98378a8ff499 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:46.380948 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b40b29aa-d30c-4e80-8f59-092ef0217494 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:46.382022 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b40b29aa-d30c-4e80-8f59-092ef0217494 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 8dea75f2-305a-4f57-b1b7-49603248c250] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:46.389892 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b40b29aa-d30c-4e80-8f59-092ef0217494 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:46.390543 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b40b29aa-d30c-4e80-8f59-092ef0217494 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:46.391114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b40b29aa-d30c-4e80-8f59-092ef0217494 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:46.392160 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b40b29aa-d30c-4e80-8f59-092ef0217494 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:46.392831 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b40b29aa-d30c-4e80-8f59-092ef0217494 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:46.393713 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b40b29aa-d30c-4e80-8f59-092ef0217494 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:46.467016 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b40b29aa-d30c-4e80-8f59-092ef0217494 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 8dea75f2-305a-4f57-b1b7-49603248c250] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:02:46.489982 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=100 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:46.658207 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e7cc354f-1ecc-43a2-9cfe-98378a8ff499 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:46.667973 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e7cc354f-1ecc-43a2-9cfe-98378a8ff499 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.317190 Sep 13 07:02:46.670731 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b40b29aa-d30c-4e80-8f59-092ef0217494 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250" status: 204 len: 0 microversion: 2.1 time: 0.294184 Sep 13 07:02:46.675804 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 113/238] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:02:46 2022] DELETE /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 07:02:46.683015 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9798d1f1-8978-4e6d-96a5-5dc8e789e812 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:46.684072 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9798d1f1-8978-4e6d-96a5-5dc8e789e812 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 8dea75f2-305a-4f57-b1b7-49603248c250] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:46.688384 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 126/239] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:46 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:46.691571 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9798d1f1-8978-4e6d-96a5-5dc8e789e812 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:46.692310 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9798d1f1-8978-4e6d-96a5-5dc8e789e812 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:46.692992 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9798d1f1-8978-4e6d-96a5-5dc8e789e812 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:46.694481 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9798d1f1-8978-4e6d-96a5-5dc8e789e812 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:46.695117 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9798d1f1-8978-4e6d-96a5-5dc8e789e812 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:46.695926 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9798d1f1-8978-4e6d-96a5-5dc8e789e812 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:47.128001 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9798d1f1-8978-4e6d-96a5-5dc8e789e812 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:47.136818 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9798d1f1-8978-4e6d-96a5-5dc8e789e812 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250" status: 200 len: 1502 microversion: 2.1 time: 0.459293 Sep 13 07:02:47.143864 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 114/240] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:46 2022] GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250 => generated 1502 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:47.697134 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cb129d29-d955-440d-a6ac-a42271fdc4a8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:47.699623 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cb129d29-d955-440d-a6ac-a42271fdc4a8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:47.710481 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb129d29-d955-440d-a6ac-a42271fdc4a8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:47.713048 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb129d29-d955-440d-a6ac-a42271fdc4a8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:47.716424 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb129d29-d955-440d-a6ac-a42271fdc4a8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:47.717393 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb129d29-d955-440d-a6ac-a42271fdc4a8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:47.718579 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb129d29-d955-440d-a6ac-a42271fdc4a8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:47.720783 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb129d29-d955-440d-a6ac-a42271fdc4a8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:48.050400 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cb129d29-d955-440d-a6ac-a42271fdc4a8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:48.082633 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cb129d29-d955-440d-a6ac-a42271fdc4a8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.390170 Sep 13 07:02:48.083817 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 127/241] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:47 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:48.170722 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ad3ef9a8-461b-4dcd-be54-4424b5d96cad tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:48.174917 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ad3ef9a8-461b-4dcd-be54-4424b5d96cad tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 8dea75f2-305a-4f57-b1b7-49603248c250] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:48.199070 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ad3ef9a8-461b-4dcd-be54-4424b5d96cad tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:48.199070 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ad3ef9a8-461b-4dcd-be54-4424b5d96cad tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:48.199070 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ad3ef9a8-461b-4dcd-be54-4424b5d96cad tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:48.199999 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ad3ef9a8-461b-4dcd-be54-4424b5d96cad tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:48.200512 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ad3ef9a8-461b-4dcd-be54-4424b5d96cad tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:48.201009 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ad3ef9a8-461b-4dcd-be54-4424b5d96cad tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:48.388157 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ad3ef9a8-461b-4dcd-be54-4424b5d96cad tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:48.399320 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ad3ef9a8-461b-4dcd-be54-4424b5d96cad tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250" status: 200 len: 1502 microversion: 2.1 time: 0.232629 Sep 13 07:02:48.400626 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 115/242] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:48 2022] GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250 => generated 1502 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:49.110304 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-74939af0-773b-42a1-8b5c-f79236be3f44 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:49.110304 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-74939af0-773b-42a1-8b5c-f79236be3f44 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:49.119154 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74939af0-773b-42a1-8b5c-f79236be3f44 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:49.120668 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74939af0-773b-42a1-8b5c-f79236be3f44 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:49.124056 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74939af0-773b-42a1-8b5c-f79236be3f44 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:49.125002 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74939af0-773b-42a1-8b5c-f79236be3f44 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:49.125636 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74939af0-773b-42a1-8b5c-f79236be3f44 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:49.126326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74939af0-773b-42a1-8b5c-f79236be3f44 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:49.424049 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9bf38265-a0da-4482-85ec-c4abec7203c1 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:49.425107 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9bf38265-a0da-4482-85ec-c4abec7203c1 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 8dea75f2-305a-4f57-b1b7-49603248c250] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:49.449467 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bf38265-a0da-4482-85ec-c4abec7203c1 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:49.449979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bf38265-a0da-4482-85ec-c4abec7203c1 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:49.454870 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-74939af0-773b-42a1-8b5c-f79236be3f44 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:49.463688 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-74939af0-773b-42a1-8b5c-f79236be3f44 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.360122 Sep 13 07:02:49.464270 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 128/243] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:49 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:49.465210 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bf38265-a0da-4482-85ec-c4abec7203c1 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:49.468154 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bf38265-a0da-4482-85ec-c4abec7203c1 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:49.468663 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bf38265-a0da-4482-85ec-c4abec7203c1 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:49.469090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bf38265-a0da-4482-85ec-c4abec7203c1 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:49.498048 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-0ce1d2b2-a47a-4fac-a45f-24872acfa04b req-de39b646-d1a6-4b3e-89b5-ad4b05194eba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dea75f2-305a-4f57-b1b7-49603248c250", "name": "network-vif-deleted", "tag": "8d07913a-b503-4a3e-86f2-3ba8a8783465"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:02:49.555341 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0ce1d2b2-a47a-4fac-a45f-24872acfa04b req-de39b646-d1a6-4b3e-89b5-ad4b05194eba service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:49.556190 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0ce1d2b2-a47a-4fac-a45f-24872acfa04b req-de39b646-d1a6-4b3e-89b5-ad4b05194eba service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:49.556672 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0ce1d2b2-a47a-4fac-a45f-24872acfa04b req-de39b646-d1a6-4b3e-89b5-ad4b05194eba service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:49.600406 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-0ce1d2b2-a47a-4fac-a45f-24872acfa04b req-de39b646-d1a6-4b3e-89b5-ad4b05194eba service nova] Creating event network-vif-deleted:8d07913a-b503-4a3e-86f2-3ba8a8783465 for instance 8dea75f2-305a-4f57-b1b7-49603248c250 on hv-cinder-85694 Sep 13 07:02:49.622212 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-0ce1d2b2-a47a-4fac-a45f-24872acfa04b req-de39b646-d1a6-4b3e-89b5-ad4b05194eba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121545 Sep 13 07:02:49.632451 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 129/244] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:02:49.690989 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9bf38265-a0da-4482-85ec-c4abec7203c1 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd897d855c64ae28ec3f10f69e9e8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81082b2f3a984d09baac046de385ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:49.700845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9bf38265-a0da-4482-85ec-c4abec7203c1 tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250" status: 200 len: 1460 microversion: 2.1 time: 0.281585 Sep 13 07:02:49.702526 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 116/245] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:49 2022] GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250 => generated 1460 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:50.496030 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-aa9b77b7-c40f-4c35-b449-680c393e834e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:50.496734 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-aa9b77b7-c40f-4c35-b449-680c393e834e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:50.507092 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aa9b77b7-c40f-4c35-b449-680c393e834e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:50.514890 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aa9b77b7-c40f-4c35-b449-680c393e834e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:50.518152 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aa9b77b7-c40f-4c35-b449-680c393e834e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:50.519279 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aa9b77b7-c40f-4c35-b449-680c393e834e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:50.522396 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aa9b77b7-c40f-4c35-b449-680c393e834e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:50.523007 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aa9b77b7-c40f-4c35-b449-680c393e834e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:50.733481 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6abb0e4d-e428-461e-82b0-1346acd3913a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:50.735086 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6abb0e4d-e428-461e-82b0-1346acd3913a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] [instance: 8dea75f2-305a-4f57-b1b7-49603248c250] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:50.745955 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6abb0e4d-e428-461e-82b0-1346acd3913a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:50.746767 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6abb0e4d-e428-461e-82b0-1346acd3913a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:50.747381 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6abb0e4d-e428-461e-82b0-1346acd3913a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:50.748583 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6abb0e4d-e428-461e-82b0-1346acd3913a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:50.750013 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6abb0e4d-e428-461e-82b0-1346acd3913a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:50.750671 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6abb0e4d-e428-461e-82b0-1346acd3913a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:50.775733 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-6abb0e4d-e428-461e-82b0-1346acd3913a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] HTTP exception thrown: Instance 8dea75f2-305a-4f57-b1b7-49603248c250 could not be found. Sep 13 07:02:50.779711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6abb0e4d-e428-461e-82b0-1346acd3913a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Request method failure captured: Sep 13 07:02:50.779711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250 HTTP/1.1 Sep 13 07:02:50.779711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:02:50.779711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:02:50.779711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:02:50.779711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:02:50.779711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:02:50.779711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:02:50.779711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:02:50.779711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:02:50.779711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICre9ovP_lpoeukuJK3KA82DlIpew9Bm50GHE3iSRHHlT9Th4dA5uTR_giJ2JFYiNSZZlMmV9FtzZN3bvY-jnDMm5qnZPdWtm3VZkUCkugHh09diYpYbKJFdlk-OvDTqvWYoKA2NtSrXlIf2X9M8HZWIWmnrIXmtj1lR_uaUZzkxqEo Sep 13 07:02:50.779711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:02:50.779711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:02:50.779711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:02:50.779711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:02:50.779711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:02:50.779711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:02:50.779711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: 81082b2f3a984d09baac046de385ea96 Sep 13 07:02:50.779711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-VolumesActionsTest-282709347 Sep 13 07:02:50.779711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:02:50.779711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:02:50.780897 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/81082b2f3a984d09baac046de385ea96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81082b2f3a984d09baac046de385ea96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81082b2f3a984d09baac046de385ea96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_81082b2f3a984d09baac046de385ea96", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:02:50.780897 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-VolumesActionsTest-282709347 Sep 13 07:02:50.780897 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 81082b2f3a984d09baac046de385ea96 Sep 13 07:02:50.780897 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-VolumesActionsTest-282709347 Sep 13 07:02:50.780897 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-VolumesActionsTest-282709347-project Sep 13 07:02:50.780897 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:02:50.780897 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:02:50.780897 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: 5bd897d855c64ae28ec3f10f69e9e8b2 Sep 13 07:02:50.780897 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-VolumesActionsTest-282709347-project Sep 13 07:02:50.780897 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:02:50.780897 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Instance 8dea75f2-305a-4f57-b1b7-49603248c250 could not be found. Sep 13 07:02:50.780897 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': '8dea75f2-305a-4f57-b1b7-49603248c250'} Sep 13 07:02:50.781610 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:02:50.781610 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:02:50.781610 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:02:50.781610 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:02:50.781610 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:02:50.781610 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:02:50.781610 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:02:50.781610 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:02:50.781610 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:02:50.781610 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:02:50.781610 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dea75f2-305a-4f57-b1b7-49603248c250 could not be found. Sep 13 07:02:50.781610 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:02:50.781610 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:02:50.781610 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:02:50.781610 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:02:50.781610 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:02:50.781610 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:02:50.781610 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:02:50.781610 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:02:50.781610 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:02:50.782775 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:02:50.782775 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:02:50.782775 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:02:50.782775 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:02:50.782775 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:02:50.782775 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:02:50.782775 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:02:50.782775 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dea75f2-305a-4f57-b1b7-49603248c250 could not be found. Sep 13 07:02:50.782775 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:02:50.782775 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:02:50.782775 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:02:50.782775 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:02:50.782775 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:02:50.782775 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:02:50.782775 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:02:50.782775 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:02:50.782775 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dea75f2-305a-4f57-b1b7-49603248c250 could not be found. Sep 13 07:02:50.782775 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:02:50.790039 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6abb0e4d-e428-461e-82b0-1346acd3913a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] Returning 404 to user: Instance 8dea75f2-305a-4f57-b1b7-49603248c250 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:02:50.792181 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6abb0e4d-e428-461e-82b0-1346acd3913a tempest-VolumesActionsTest-282709347 tempest-VolumesActionsTest-282709347-project] 10.222.0.25 "GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250" status: 404 len: 111 microversion: 2.1 time: 0.064045 Sep 13 07:02:50.798564 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 117/246] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:50 2022] GET /compute/v2.1/servers/8dea75f2-305a-4f57-b1b7-49603248c250 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:02:51.589909 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-aa9b77b7-c40f-4c35-b449-680c393e834e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:51.617794 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-aa9b77b7-c40f-4c35-b449-680c393e834e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 1.124285 Sep 13 07:02:51.618930 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 130/247] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:50 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:51.796569 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a2c4f789-b833-4963-b164-a130a1be728f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:51.797827 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a2c4f789-b833-4963-b164-a130a1be728f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:51.808451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a2c4f789-b833-4963-b164-a130a1be728f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:51.808939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a2c4f789-b833-4963-b164-a130a1be728f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:51.809363 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a2c4f789-b833-4963-b164-a130a1be728f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:51.810056 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a2c4f789-b833-4963-b164-a130a1be728f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:51.810523 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a2c4f789-b833-4963-b164-a130a1be728f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:51.810930 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a2c4f789-b833-4963-b164-a130a1be728f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:51.896490 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a2c4f789-b833-4963-b164-a130a1be728f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd/ips" status: 200 len: 149 microversion: 2.1 time: 0.103744 Sep 13 07:02:51.897480 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 118/248] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Sep 13 07:02:51 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd/ips => generated 149 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:02:52.647983 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-94f1b423-0a44-42f3-9ae1-b1063ac1e29c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:52.648520 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-94f1b423-0a44-42f3-9ae1-b1063ac1e29c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:52.669886 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94f1b423-0a44-42f3-9ae1-b1063ac1e29c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:52.670492 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94f1b423-0a44-42f3-9ae1-b1063ac1e29c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:52.670928 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94f1b423-0a44-42f3-9ae1-b1063ac1e29c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:52.671628 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94f1b423-0a44-42f3-9ae1-b1063ac1e29c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:52.672062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94f1b423-0a44-42f3-9ae1-b1063ac1e29c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:52.672472 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94f1b423-0a44-42f3-9ae1-b1063ac1e29c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:52.985148 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-94f1b423-0a44-42f3-9ae1-b1063ac1e29c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:52.995598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-94f1b423-0a44-42f3-9ae1-b1063ac1e29c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.351425 Sep 13 07:02:52.996846 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 131/249] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:52 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:54.024760 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b913dfdf-4123-4a70-ba98-75b72de7fea7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:54.026217 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b913dfdf-4123-4a70-ba98-75b72de7fea7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:54.034916 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b913dfdf-4123-4a70-ba98-75b72de7fea7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:54.035607 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b913dfdf-4123-4a70-ba98-75b72de7fea7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:54.036108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b913dfdf-4123-4a70-ba98-75b72de7fea7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:54.036843 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b913dfdf-4123-4a70-ba98-75b72de7fea7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:54.039511 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b913dfdf-4123-4a70-ba98-75b72de7fea7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:54.040129 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b913dfdf-4123-4a70-ba98-75b72de7fea7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:54.366137 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b913dfdf-4123-4a70-ba98-75b72de7fea7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:54.374979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b913dfdf-4123-4a70-ba98-75b72de7fea7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.359778 Sep 13 07:02:54.375570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 119/250] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:54 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:54.456951 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-40d12a8d-ef11-4b2e-b3ca-5c6e9b1e07c9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:54.457989 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-40d12a8d-ef11-4b2e-b3ca-5c6e9b1e07c9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:54.465217 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-40d12a8d-ef11-4b2e-b3ca-5c6e9b1e07c9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:54.466034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-40d12a8d-ef11-4b2e-b3ca-5c6e9b1e07c9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:54.466718 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-40d12a8d-ef11-4b2e-b3ca-5c6e9b1e07c9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:54.468076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-40d12a8d-ef11-4b2e-b3ca-5c6e9b1e07c9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:54.468727 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-40d12a8d-ef11-4b2e-b3ca-5c6e9b1e07c9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:54.469353 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-40d12a8d-ef11-4b2e-b3ca-5c6e9b1e07c9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:54.499314 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-40d12a8d-ef11-4b2e-b3ca-5c6e9b1e07c9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad/ips" status: 200 len: 152 microversion: 2.20 time: 0.045701 Sep 13 07:02:54.501020 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 132/251] 10.222.0.25 () {60 vars in 1289 bytes} [Tue Sep 13 07:02:54 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad/ips => generated 152 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:02:55.402252 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-954a8959-723c-489c-b513-9c969aaaa5c5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:55.402802 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-954a8959-723c-489c-b513-9c969aaaa5c5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:55.411933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-954a8959-723c-489c-b513-9c969aaaa5c5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:55.412603 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-954a8959-723c-489c-b513-9c969aaaa5c5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:55.413874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-954a8959-723c-489c-b513-9c969aaaa5c5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:55.414781 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-954a8959-723c-489c-b513-9c969aaaa5c5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:55.415374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-954a8959-723c-489c-b513-9c969aaaa5c5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:55.415935 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-954a8959-723c-489c-b513-9c969aaaa5c5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:55.660453 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-954a8959-723c-489c-b513-9c969aaaa5c5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:55.674509 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-954a8959-723c-489c-b513-9c969aaaa5c5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.277017 Sep 13 07:02:55.688241 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 120/252] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:55 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:56.705239 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-69dc0ede-6632-4539-a214-c36439298662 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:56.706781 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-69dc0ede-6632-4539-a214-c36439298662 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:56.723969 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-69dc0ede-6632-4539-a214-c36439298662 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:56.726830 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-69dc0ede-6632-4539-a214-c36439298662 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:56.727308 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-69dc0ede-6632-4539-a214-c36439298662 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:56.735338 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-69dc0ede-6632-4539-a214-c36439298662 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:56.736456 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-69dc0ede-6632-4539-a214-c36439298662 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:56.739890 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-69dc0ede-6632-4539-a214-c36439298662 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:56.999658 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-69dc0ede-6632-4539-a214-c36439298662 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:57.009198 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-69dc0ede-6632-4539-a214-c36439298662 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.312096 Sep 13 07:02:57.010241 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 133/253] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:56 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:58.036475 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bbb2ab0d-56f8-4d09-adc2-554d95b3a850 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:58.037143 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bbb2ab0d-56f8-4d09-adc2-554d95b3a850 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:58.046147 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bbb2ab0d-56f8-4d09-adc2-554d95b3a850 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:58.046644 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bbb2ab0d-56f8-4d09-adc2-554d95b3a850 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:58.048002 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bbb2ab0d-56f8-4d09-adc2-554d95b3a850 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:58.048872 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bbb2ab0d-56f8-4d09-adc2-554d95b3a850 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:58.050183 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bbb2ab0d-56f8-4d09-adc2-554d95b3a850 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:58.050913 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bbb2ab0d-56f8-4d09-adc2-554d95b3a850 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:58.248096 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bbb2ab0d-56f8-4d09-adc2-554d95b3a850 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:58.258907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bbb2ab0d-56f8-4d09-adc2-554d95b3a850 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.227438 Sep 13 07:02:58.265100 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 121/254] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:58 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:59.234848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-691a38f2-3981-4e04-9190-4fbeddf5a92d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6751156-b7a1-49fc-8c48-aaa808bcdc38"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:02:59.240569 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-691a38f2-3981-4e04-9190-4fbeddf5a92d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:59.249296 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-691a38f2-3981-4e04-9190-4fbeddf5a92d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:59.249940 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-691a38f2-3981-4e04-9190-4fbeddf5a92d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:59.250566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-691a38f2-3981-4e04-9190-4fbeddf5a92d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:59.251418 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-691a38f2-3981-4e04-9190-4fbeddf5a92d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:59.252002 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-691a38f2-3981-4e04-9190-4fbeddf5a92d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:59.252551 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-691a38f2-3981-4e04-9190-4fbeddf5a92d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:59.287886 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-fb1cb4bf-e76e-4146-ad14-db2b9eba1002 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:02:59.289225 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-fb1cb4bf-e76e-4146-ad14-db2b9eba1002 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:59.300777 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:59.304344 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fb1cb4bf-e76e-4146-ad14-db2b9eba1002 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:59.307471 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fb1cb4bf-e76e-4146-ad14-db2b9eba1002 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:59.308422 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fb1cb4bf-e76e-4146-ad14-db2b9eba1002 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:59.312235 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fb1cb4bf-e76e-4146-ad14-db2b9eba1002 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:59.313919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fb1cb4bf-e76e-4146-ad14-db2b9eba1002 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:59.316222 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fb1cb4bf-e76e-4146-ad14-db2b9eba1002 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:59.638322 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-fb1cb4bf-e76e-4146-ad14-db2b9eba1002 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:02:59.648894 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-fb1cb4bf-e76e-4146-ad14-db2b9eba1002 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.366620 Sep 13 07:02:59.650361 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 122/255] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:02:59 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:02:59.914781 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-691a38f2-3981-4e04-9190-4fbeddf5a92d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "POST /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.686006 Sep 13 07:02:59.916049 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 134/256] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Sep 13 07:02:59 2022] POST /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd/os-volume_attachments => generated 194 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:02:59.933221 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6e33a642-0097-4186-9d46-45895595a2d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:02:59.934214 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6e33a642-0097-4186-9d46-45895595a2d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:02:59.960966 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e33a642-0097-4186-9d46-45895595a2d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:59.963055 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e33a642-0097-4186-9d46-45895595a2d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:59.964975 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e33a642-0097-4186-9d46-45895595a2d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:02:59.972751 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e33a642-0097-4186-9d46-45895595a2d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:02:59.974280 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e33a642-0097-4186-9d46-45895595a2d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:02:59.975926 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e33a642-0097-4186-9d46-45895595a2d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:00.554930 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-6e33a642-0097-4186-9d46-45895595a2d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lazy-loading 'flavor' on Instance uuid 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:03:00.677245 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a779db78-dbdf-4834-99de-662fa4a14b0c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:00.680076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a779db78-dbdf-4834-99de-662fa4a14b0c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:00.697940 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=48 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:00.706293 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a779db78-dbdf-4834-99de-662fa4a14b0c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:00.716860 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a779db78-dbdf-4834-99de-662fa4a14b0c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:00.720482 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a779db78-dbdf-4834-99de-662fa4a14b0c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:00.724007 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a779db78-dbdf-4834-99de-662fa4a14b0c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:00.727005 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a779db78-dbdf-4834-99de-662fa4a14b0c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:00.730708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a779db78-dbdf-4834-99de-662fa4a14b0c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:01.118935 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a779db78-dbdf-4834-99de-662fa4a14b0c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:01.136894 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a779db78-dbdf-4834-99de-662fa4a14b0c tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.468374 Sep 13 07:03:01.137490 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 135/257] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:00 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:02.168017 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-831680bc-7653-4132-a8c8-0fd215d6c642 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:02.170057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-831680bc-7653-4132-a8c8-0fd215d6c642 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:02.195887 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-831680bc-7653-4132-a8c8-0fd215d6c642 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:02.202808 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-831680bc-7653-4132-a8c8-0fd215d6c642 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:02.203277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-831680bc-7653-4132-a8c8-0fd215d6c642 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:02.206850 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-831680bc-7653-4132-a8c8-0fd215d6c642 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:02.211709 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-831680bc-7653-4132-a8c8-0fd215d6c642 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:02.212659 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-831680bc-7653-4132-a8c8-0fd215d6c642 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:02.606054 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-831680bc-7653-4132-a8c8-0fd215d6c642 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:02.619714 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-831680bc-7653-4132-a8c8-0fd215d6c642 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.456007 Sep 13 07:03:02.623052 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 136/258] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:02 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:03:03.653666 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-12c69c50-b91d-4e57-8dd0-5b412a45e705 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:03.655074 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-12c69c50-b91d-4e57-8dd0-5b412a45e705 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:03.665387 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12c69c50-b91d-4e57-8dd0-5b412a45e705 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:03.673640 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12c69c50-b91d-4e57-8dd0-5b412a45e705 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:03.674178 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12c69c50-b91d-4e57-8dd0-5b412a45e705 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:03.674886 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12c69c50-b91d-4e57-8dd0-5b412a45e705 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:03.675347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12c69c50-b91d-4e57-8dd0-5b412a45e705 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:03.675773 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12c69c50-b91d-4e57-8dd0-5b412a45e705 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:03.958043 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-12c69c50-b91d-4e57-8dd0-5b412a45e705 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:03.969507 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-12c69c50-b91d-4e57-8dd0-5b412a45e705 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.320162 Sep 13 07:03:03.970130 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 137/259] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:03 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:03:04.992796 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5c14ba93-4aac-4aed-8cf0-0f3cf5642e2b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:04.995576 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5c14ba93-4aac-4aed-8cf0-0f3cf5642e2b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:05.012147 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c14ba93-4aac-4aed-8cf0-0f3cf5642e2b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:05.013038 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c14ba93-4aac-4aed-8cf0-0f3cf5642e2b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:05.013705 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c14ba93-4aac-4aed-8cf0-0f3cf5642e2b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:05.014711 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c14ba93-4aac-4aed-8cf0-0f3cf5642e2b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:05.017668 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c14ba93-4aac-4aed-8cf0-0f3cf5642e2b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:05.018864 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c14ba93-4aac-4aed-8cf0-0f3cf5642e2b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:05.238231 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5c14ba93-4aac-4aed-8cf0-0f3cf5642e2b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:05.248364 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5c14ba93-4aac-4aed-8cf0-0f3cf5642e2b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.259499 Sep 13 07:03:05.262661 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 138/260] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:04 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:06.274366 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d04f15f4-391f-404d-a326-4ef0fe7cd7a9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:06.275458 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d04f15f4-391f-404d-a326-4ef0fe7cd7a9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:06.298653 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d04f15f4-391f-404d-a326-4ef0fe7cd7a9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:06.299305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d04f15f4-391f-404d-a326-4ef0fe7cd7a9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:06.299739 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d04f15f4-391f-404d-a326-4ef0fe7cd7a9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:06.301356 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d04f15f4-391f-404d-a326-4ef0fe7cd7a9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:06.301958 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d04f15f4-391f-404d-a326-4ef0fe7cd7a9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:06.302550 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d04f15f4-391f-404d-a326-4ef0fe7cd7a9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:06.588717 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d04f15f4-391f-404d-a326-4ef0fe7cd7a9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:06.602059 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d04f15f4-391f-404d-a326-4ef0fe7cd7a9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.332658 Sep 13 07:03:06.616123 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 139/261] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:06 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:07.631148 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-960e37aa-5202-4a6b-afdf-d2a4fbea29ec tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:07.631886 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-960e37aa-5202-4a6b-afdf-d2a4fbea29ec tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:07.639980 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-960e37aa-5202-4a6b-afdf-d2a4fbea29ec tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:07.640801 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-960e37aa-5202-4a6b-afdf-d2a4fbea29ec tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:07.641443 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-960e37aa-5202-4a6b-afdf-d2a4fbea29ec tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:07.642376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-960e37aa-5202-4a6b-afdf-d2a4fbea29ec tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:07.643056 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-960e37aa-5202-4a6b-afdf-d2a4fbea29ec tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:07.643708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-960e37aa-5202-4a6b-afdf-d2a4fbea29ec tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:07.906922 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-960e37aa-5202-4a6b-afdf-d2a4fbea29ec tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:07.910730 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:07.917041 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-960e37aa-5202-4a6b-afdf-d2a4fbea29ec tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.290257 Sep 13 07:03:07.917608 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 140/262] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:07 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:08.210108 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b60dcb36-3d95-456d-adf1-e77fa1ef4a02 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Action: 'create', calling method: .version_select at 0x7f4c19731a60>, body: {"keypair": {"name": "tempest-keypair-404433140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmIwfqgz9FrM8oIAZ4rM8VD8djImOnzsRO8/gyR4D9N/XRBa+jhNW4kvmsD2nRmmsBuL9u5bUj8YhOJIrYkJM61BkzAGd+PChDJyW+2rhrbFeOLjQuZxNHbEX2JvymSIA=="}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:03:08.263245 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-b60dcb36-3d95-456d-adf1-e77fa1ef4a02 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Getting quotas for project 8c7dc05c1c9d40b2bb0defc9dd157d6e. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:03:08.273675 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-b60dcb36-3d95-456d-adf1-e77fa1ef4a02 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Getting quotas for user 5a0fd7347cad41bc80f427f872cf78fa and project 8c7dc05c1c9d40b2bb0defc9dd157d6e. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:03:08.331789 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b60dcb36-3d95-456d-adf1-e77fa1ef4a02 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.134993 Sep 13 07:03:08.333110 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 141/263] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Sep 13 07:03:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:03:08.941220 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-74aa6280-22c9-4043-9e04-65de8fe12695 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:08.942021 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-74aa6280-22c9-4043-9e04-65de8fe12695 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:08.958843 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74aa6280-22c9-4043-9e04-65de8fe12695 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:08.962730 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74aa6280-22c9-4043-9e04-65de8fe12695 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:08.974339 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74aa6280-22c9-4043-9e04-65de8fe12695 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:08.974339 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74aa6280-22c9-4043-9e04-65de8fe12695 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:08.974339 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74aa6280-22c9-4043-9e04-65de8fe12695 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:08.974339 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74aa6280-22c9-4043-9e04-65de8fe12695 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:09.339173 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-74aa6280-22c9-4043-9e04-65de8fe12695 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:09.351413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-74aa6280-22c9-4043-9e04-65de8fe12695 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.414032 Sep 13 07:03:09.351995 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 142/264] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:08 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:03:09.944551 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:10.377162 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7e93b1d3-330c-494b-a119-2a9506db1a99 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:10.380616 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7e93b1d3-330c-494b-a119-2a9506db1a99 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:10.417529 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7e93b1d3-330c-494b-a119-2a9506db1a99 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:10.418316 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7e93b1d3-330c-494b-a119-2a9506db1a99 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:10.424916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7e93b1d3-330c-494b-a119-2a9506db1a99 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:10.426014 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7e93b1d3-330c-494b-a119-2a9506db1a99 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:10.426723 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7e93b1d3-330c-494b-a119-2a9506db1a99 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:10.427385 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7e93b1d3-330c-494b-a119-2a9506db1a99 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:10.786893 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7e93b1d3-330c-494b-a119-2a9506db1a99 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:10.803930 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7e93b1d3-330c-494b-a119-2a9506db1a99 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.430491 Sep 13 07:03:10.804543 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 143/265] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:10 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:03:10.836455 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:11.053059 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-45340eb9-17ed-458d-a6de-1a3285459dcd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-20558126", "imageRef": "19a6700e-e153-4bea-87aa-036bfccf0ecd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "672f9e05-334a-4483-b823-bb14da4544d0"}], "security_groups": [{"name": "tempest-securitygroup--563432013"}], "key_name": "tempest-keypair-404433140", "user_data": "}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:03:12.615724 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6e33a642-0097-4186-9d46-45895595a2d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "POST /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad/action" status: 202 len: 0 microversion: 2.20 time: 12.697742 Sep 13 07:03:12.618322 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 123/266] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Sep 13 07:02:59 2022] POST /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad/action => generated 0 bytes in 12703 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:03:12.628290 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-96fefe2d-4e28-4c84-b8c3-fdf08a80c8a1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:12.629682 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-96fefe2d-4e28-4c84-b8c3-fdf08a80c8a1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:12.641651 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-96fefe2d-4e28-4c84-b8c3-fdf08a80c8a1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:12.643309 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-96fefe2d-4e28-4c84-b8c3-fdf08a80c8a1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:12.643947 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-96fefe2d-4e28-4c84-b8c3-fdf08a80c8a1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:12.644994 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-96fefe2d-4e28-4c84-b8c3-fdf08a80c8a1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:12.645606 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-96fefe2d-4e28-4c84-b8c3-fdf08a80c8a1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:12.646205 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-96fefe2d-4e28-4c84-b8c3-fdf08a80c8a1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:12.808493 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-45340eb9-17ed-458d-a6de-1a3285459dcd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] validate_networks() for [('672f9e05-334a-4483-b823-bb14da4544d0', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:03:13.086355 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-96fefe2d-4e28-4c84-b8c3-fdf08a80c8a1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:13.098358 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-96fefe2d-4e28-4c84-b8c3-fdf08a80c8a1 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.475422 Sep 13 07:03:13.098965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 124/267] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:12 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:13.119045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4d74dc65-35df-452c-8413-6d398bebf077 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Action: 'create', calling method: .version_select at 0x7f4c19928af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-753796199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhS/fmuYvCTCNRcNzVYW3Tq9MMJkh9ElWg9fHAOw94ofInESiR+BS7p5cDM7YwrKyySfpj7IZFsb3DGbhmRYOr5QcEubHOaYR63YRfEuSFacS6D8oKeuylm5ZJEnHBouA=="}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:03:13.156595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-4d74dc65-35df-452c-8413-6d398bebf077 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Getting quotas for project 76569a470885443abfbe4e14e9b2f505. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:03:13.162460 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-4d74dc65-35df-452c-8413-6d398bebf077 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Getting quotas for user baa15cc84259470f93afcfe23ef55c2f and project 76569a470885443abfbe4e14e9b2f505. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:03:13.217623 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4d74dc65-35df-452c-8413-6d398bebf077 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.105744 Sep 13 07:03:13.218269 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 125/268] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Sep 13 07:03:13 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:03:13.225614 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8091d972-930a-40da-a2a3-20cc59e80fe5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:13.227162 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8091d972-930a-40da-a2a3-20cc59e80fe5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:13.243631 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8091d972-930a-40da-a2a3-20cc59e80fe5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:13.244605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8091d972-930a-40da-a2a3-20cc59e80fe5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:13.245239 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8091d972-930a-40da-a2a3-20cc59e80fe5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:13.246116 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8091d972-930a-40da-a2a3-20cc59e80fe5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:13.246731 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8091d972-930a-40da-a2a3-20cc59e80fe5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:13.247299 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8091d972-930a-40da-a2a3-20cc59e80fe5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:13.702361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-45340eb9-17ed-458d-a6de-1a3285459dcd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:03:13.703730 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-45340eb9-17ed-458d-a6de-1a3285459dcd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:03:13.705121 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-45340eb9-17ed-458d-a6de-1a3285459dcd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:03:13.707351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-45340eb9-17ed-458d-a6de-1a3285459dcd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:03:13.708260 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-45340eb9-17ed-458d-a6de-1a3285459dcd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:03:13.717173 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8091d972-930a-40da-a2a3-20cc59e80fe5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:13.733515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8091d972-930a-40da-a2a3-20cc59e80fe5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:13.736123 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8091d972-930a-40da-a2a3-20cc59e80fe5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:13.737335 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8091d972-930a-40da-a2a3-20cc59e80fe5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1723 microversion: 2.20 time: 0.515590 Sep 13 07:03:13.744362 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-45340eb9-17ed-458d-a6de-1a3285459dcd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:13.745158 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-45340eb9-17ed-458d-a6de-1a3285459dcd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:13.745839 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-45340eb9-17ed-458d-a6de-1a3285459dcd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:13.746125 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 126/269] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:13 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1723 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:03:13.747474 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-45340eb9-17ed-458d-a6de-1a3285459dcd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:13.748236 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-45340eb9-17ed-458d-a6de-1a3285459dcd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:13.749012 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-45340eb9-17ed-458d-a6de-1a3285459dcd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:13.760525 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e0b5da4c-b66d-492c-8c91-607d38e09668 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-367952783", "imageRef": "b7a0008a-f3bf-4d3e-8216-6f51aafbbb8d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-753796199", "networks": [{"uuid": "0cffbe9d-fe13-461f-aaa8-05916e53ec62"}]}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:03:13.825841 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-45340eb9-17ed-458d-a6de-1a3285459dcd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Getting quotas for project 8c7dc05c1c9d40b2bb0defc9dd157d6e. Resources: {'instances', 'cores', 'ram'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:03:13.840849 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-45340eb9-17ed-458d-a6de-1a3285459dcd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Getting quotas for user 5a0fd7347cad41bc80f427f872cf78fa and project 8c7dc05c1c9d40b2bb0defc9dd157d6e. Resources: {'instances', 'cores', 'ram'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:03:13.876652 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-45340eb9-17ed-458d-a6de-1a3285459dcd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:03:13.892638 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-45340eb9-17ed-458d-a6de-1a3285459dcd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='19a6700e-e153-4bea-87aa-036bfccf0ecd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:03:13.967659 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-e0b5da4c-b66d-492c-8c91-607d38e09668 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] validate_networks() for [('0cffbe9d-fe13-461f-aaa8-05916e53ec62', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:03:14.002841 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-45340eb9-17ed-458d-a6de-1a3285459dcd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.962938 Sep 13 07:03:14.003494 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 144/270] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Sep 13 07:03:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 2964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 07:03:14.018899 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b79baa65-ded7-4e9f-9853-377bfde99807 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:14.019914 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b79baa65-ded7-4e9f-9853-377bfde99807 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:14.135859 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b79baa65-ded7-4e9f-9853-377bfde99807 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:14.149017 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b79baa65-ded7-4e9f-9853-377bfde99807 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1239 microversion: 2.1 time: 0.137254 Sep 13 07:03:14.151595 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 145/271] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:14 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1239 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:03:14.163745 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ae6be25e-0485-48fb-8b44-1dce498b95c4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:14.164455 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ae6be25e-0485-48fb-8b44-1dce498b95c4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:14.177361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae6be25e-0485-48fb-8b44-1dce498b95c4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:14.177925 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae6be25e-0485-48fb-8b44-1dce498b95c4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:14.178341 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae6be25e-0485-48fb-8b44-1dce498b95c4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:14.179003 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae6be25e-0485-48fb-8b44-1dce498b95c4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:14.179553 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae6be25e-0485-48fb-8b44-1dce498b95c4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:14.179864 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae6be25e-0485-48fb-8b44-1dce498b95c4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:14.495740 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ae6be25e-0485-48fb-8b44-1dce498b95c4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:14.505656 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ae6be25e-0485-48fb-8b44-1dce498b95c4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.350424 Sep 13 07:03:14.507206 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 146/272] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:14 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:14.659243 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-e0b5da4c-b66d-492c-8c91-607d38e09668 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:03:14.659795 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-e0b5da4c-b66d-492c-8c91-607d38e09668 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:03:14.660360 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-e0b5da4c-b66d-492c-8c91-607d38e09668 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:03:14.661023 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-e0b5da4c-b66d-492c-8c91-607d38e09668 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:03:14.661606 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-e0b5da4c-b66d-492c-8c91-607d38e09668 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:03:14.680100 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e0b5da4c-b66d-492c-8c91-607d38e09668 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:14.681034 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e0b5da4c-b66d-492c-8c91-607d38e09668 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:14.681771 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e0b5da4c-b66d-492c-8c91-607d38e09668 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:14.682652 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e0b5da4c-b66d-492c-8c91-607d38e09668 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:14.683489 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e0b5da4c-b66d-492c-8c91-607d38e09668 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:14.684117 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e0b5da4c-b66d-492c-8c91-607d38e09668 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:14.709230 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-e0b5da4c-b66d-492c-8c91-607d38e09668 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Getting quotas for project 76569a470885443abfbe4e14e9b2f505. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:03:14.713305 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-e0b5da4c-b66d-492c-8c91-607d38e09668 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Getting quotas for user baa15cc84259470f93afcfe23ef55c2f and project 76569a470885443abfbe4e14e9b2f505. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:03:14.724692 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e0b5da4c-b66d-492c-8c91-607d38e09668 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:03:14.727048 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e0b5da4c-b66d-492c-8c91-607d38e09668 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b7a0008a-f3bf-4d3e-8216-6f51aafbbb8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:03:14.766544 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-17a06c69-e77d-4858-964f-75a93973e577 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:14.767452 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-17a06c69-e77d-4858-964f-75a93973e577 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:14.774634 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-17a06c69-e77d-4858-964f-75a93973e577 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:14.775481 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-17a06c69-e77d-4858-964f-75a93973e577 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:14.776147 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-17a06c69-e77d-4858-964f-75a93973e577 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:14.777080 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-17a06c69-e77d-4858-964f-75a93973e577 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:14.777681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-17a06c69-e77d-4858-964f-75a93973e577 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:14.778321 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-17a06c69-e77d-4858-964f-75a93973e577 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:14.840226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e0b5da4c-b66d-492c-8c91-607d38e09668 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.090676 Sep 13 07:03:14.851251 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 127/273] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Sep 13 07:03:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 07:03:14.862293 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-486564b0-e4c3-4506-b3d0-46ff854142d7 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:14.865080 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-486564b0-e4c3-4506-b3d0-46ff854142d7 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:15.005657 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-486564b0-e4c3-4506-b3d0-46ff854142d7 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:15.032111 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-486564b0-e4c3-4506-b3d0-46ff854142d7 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1257 microversion: 2.1 time: 0.176040 Sep 13 07:03:15.032725 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 128/274] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:14 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1257 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:15.063613 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-17a06c69-e77d-4858-964f-75a93973e577 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:15.076788 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-17a06c69-e77d-4858-964f-75a93973e577 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:15.078795 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-17a06c69-e77d-4858-964f-75a93973e577 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:15.080595 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-17a06c69-e77d-4858-964f-75a93973e577 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1723 microversion: 2.20 time: 0.317693 Sep 13 07:03:15.081348 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 147/275] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:14 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:03:15.175838 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-677570b2-f18a-4d37-bb7b-de701202d138 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:15.176651 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-677570b2-f18a-4d37-bb7b-de701202d138 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:15.184830 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-677570b2-f18a-4d37-bb7b-de701202d138 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:15.185403 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-677570b2-f18a-4d37-bb7b-de701202d138 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:15.185835 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-677570b2-f18a-4d37-bb7b-de701202d138 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:15.186928 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-677570b2-f18a-4d37-bb7b-de701202d138 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:15.187407 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-677570b2-f18a-4d37-bb7b-de701202d138 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:15.187826 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-677570b2-f18a-4d37-bb7b-de701202d138 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:15.291226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-677570b2-f18a-4d37-bb7b-de701202d138 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:15.302764 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-677570b2-f18a-4d37-bb7b-de701202d138 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1235 microversion: 2.1 time: 0.133089 Sep 13 07:03:15.303583 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 129/276] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:15 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1235 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:15.537478 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1314b9da-28b4-47b9-a54f-f12adb0595d8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:15.538128 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1314b9da-28b4-47b9-a54f-f12adb0595d8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:15.557562 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1314b9da-28b4-47b9-a54f-f12adb0595d8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:15.561361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1314b9da-28b4-47b9-a54f-f12adb0595d8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:15.564148 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1314b9da-28b4-47b9-a54f-f12adb0595d8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:15.566318 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1314b9da-28b4-47b9-a54f-f12adb0595d8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:15.566999 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1314b9da-28b4-47b9-a54f-f12adb0595d8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:15.567717 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1314b9da-28b4-47b9-a54f-f12adb0595d8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:15.812996 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1314b9da-28b4-47b9-a54f-f12adb0595d8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:15.822431 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1314b9da-28b4-47b9-a54f-f12adb0595d8 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1499 microversion: 2.1 time: 0.290094 Sep 13 07:03:15.823794 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 148/277] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:15 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1499 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:15.849940 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-50cab8aa-a18f-450c-9483-014f116f30cd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19f35b50-1fd8-4d3b-bdb0-7446962c7563"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:03:15.853088 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-50cab8aa-a18f-450c-9483-014f116f30cd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:15.861578 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-50cab8aa-a18f-450c-9483-014f116f30cd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:15.862314 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-50cab8aa-a18f-450c-9483-014f116f30cd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:15.862931 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-50cab8aa-a18f-450c-9483-014f116f30cd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:15.863798 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-50cab8aa-a18f-450c-9483-014f116f30cd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:15.864401 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-50cab8aa-a18f-450c-9483-014f116f30cd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:15.865568 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-50cab8aa-a18f-450c-9483-014f116f30cd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:15.896462 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-50cab8aa-a18f-450c-9483-014f116f30cd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] HTTP exception thrown: Cannot 'attach_volume' instance 8082cb10-169b-478f-9b71-7680fe245559 while it is in vm_state rescued Sep 13 07:03:15.899332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-50cab8aa-a18f-450c-9483-014f116f30cd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Request method failure captured: Sep 13 07:03:15.899332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: POST /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559/os-volume_attachments HTTP/1.1 Sep 13 07:03:15.899332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:03:15.899332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:03:15.899332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:03:15.899332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 74 Sep 13 07:03:15.899332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:03:15.899332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:03:15.899332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:03:15.899332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:03:15.899332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICqyQRLq_Qa1Tuxe68eosGmwt0cfbE0QkaoApj_vZMNT1tVfE9Z1aCGGEvvN2J5jEsNGtKZpwqKXbs-2kDkDTvieMwn3svXsvAJgMxZJF1u4g7iovW_UVB6Z-NWEeEosMH3ZRZftb8qQnq25CtsFAl2rJIxNetNMQK-S7hv1WD2Jc6s Sep 13 07:03:15.899332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:03:15.899332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:03:15.899332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:03:15.899332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:03:15.899332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:03:15.899332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:03:15.899332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: 38b6d7b146a34896bb8309e2c51348f8 Sep 13 07:03:15.899332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-806686784 Sep 13 07:03:15.899332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:03:15.899332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:03:15.901096 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b6d7b146a34896bb8309e2c51348f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b6d7b146a34896bb8309e2c51348f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b6d7b146a34896bb8309e2c51348f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b6d7b146a34896bb8309e2c51348f8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:03:15.901096 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-ServerRescueNegativeTestJSON-806686784 Sep 13 07:03:15.901096 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 38b6d7b146a34896bb8309e2c51348f8 Sep 13 07:03:15.901096 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-806686784 Sep 13 07:03:15.901096 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-ServerRescueNegativeTestJSON-806686784-project Sep 13 07:03:15.901096 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:03:15.901096 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:03:15.901096 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: 0d8d0ff010c04d65b36ebe65c1cbbbfd Sep 13 07:03:15.901096 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-ServerRescueNegativeTestJSON-806686784-project Sep 13 07:03:15.901096 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Sep 13 07:03:15.901096 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {"volumeAttachment": {"volumeId": "19f35b50-1fd8-4d3b-bdb0-7446962c7563"}} Sep 13 07:03:15.901096 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:03:15.901988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Cannot 'attach_volume' instance 8082cb10-169b-478f-9b71-7680fe245559 while it is in vm_state rescued Sep 13 07:03:15.901988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'server_id': '8082cb10-169b-478f-9b71-7680fe245559', 'body': {'volumeAttachment': {'volumeId': '19f35b50-1fd8-4d3b-bdb0-7446962c7563'}}} Sep 13 07:03:15.901988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:03:15.901988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:03:15.901988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 07:03:15.901988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 07:03:15.901988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 07:03:15.901988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 07:03:15.901988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 07:03:15.901988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 07:03:15.901988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8082cb10-169b-478f-9b71-7680fe245559 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 13 07:03:15.901988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:03:15.901988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:03:15.901988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:03:15.901988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:03:15.901988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:03:15.901988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:03:15.901988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:03:15.901988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:03:15.903412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:03:15.903412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:03:15.903412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 07:03:15.903412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 07:03:15.903412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 07:03:15.903412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 07:03:15.903412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 07:03:15.903412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 07:03:15.903412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 13 07:03:15.903412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 07:03:15.903412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 07:03:15.903412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 07:03:15.903412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8082cb10-169b-478f-9b71-7680fe245559 while it is in vm_state rescued Sep 13 07:03:15.903412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:03:15.903412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:03:15.903412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:03:15.903412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:03:15.903412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:03:15.903412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:03:15.904748 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:03:15.904748 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:03:15.904748 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8082cb10-169b-478f-9b71-7680fe245559 while it is in vm_state rescued Sep 13 07:03:15.904748 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:03:15.905803 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-50cab8aa-a18f-450c-9483-014f116f30cd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Returning 409 to user: Cannot 'attach_volume' instance 8082cb10-169b-478f-9b71-7680fe245559 while it is in vm_state rescued {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:03:15.906714 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-50cab8aa-a18f-450c-9483-014f116f30cd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "POST /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.061851 Sep 13 07:03:15.910555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 130/278] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Sep 13 07:03:15 2022] POST /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559/os-volume_attachments => generated 152 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 07:03:15.916184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b50b91d9-e65c-4cee-ac33-48d641b7362e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:03:15.916802 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b50b91d9-e65c-4cee-ac33-48d641b7362e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:15.923748 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b50b91d9-e65c-4cee-ac33-48d641b7362e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:15.924221 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b50b91d9-e65c-4cee-ac33-48d641b7362e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:15.924653 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b50b91d9-e65c-4cee-ac33-48d641b7362e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:15.925329 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b50b91d9-e65c-4cee-ac33-48d641b7362e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:15.925926 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b50b91d9-e65c-4cee-ac33-48d641b7362e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:15.926528 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b50b91d9-e65c-4cee-ac33-48d641b7362e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:16.036289 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b50b91d9-e65c-4cee-ac33-48d641b7362e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "POST /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559/action" status: 202 len: 0 microversion: 2.1 time: 0.123891 Sep 13 07:03:16.040068 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 149/279] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Sep 13 07:03:15 2022] POST /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:03:16.045557 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-178442bc-fa57-42c9-92d8-68b95c0c0b1a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:16.046655 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-178442bc-fa57-42c9-92d8-68b95c0c0b1a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:16.058144 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-178442bc-fa57-42c9-92d8-68b95c0c0b1a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:16.060354 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-178442bc-fa57-42c9-92d8-68b95c0c0b1a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:16.061670 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-178442bc-fa57-42c9-92d8-68b95c0c0b1a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:16.062641 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-178442bc-fa57-42c9-92d8-68b95c0c0b1a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:16.064998 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-178442bc-fa57-42c9-92d8-68b95c0c0b1a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:16.065918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-178442bc-fa57-42c9-92d8-68b95c0c0b1a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:16.067976 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bb3ed3fc-1425-43db-953c-e5f722a55581 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:16.068667 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bb3ed3fc-1425-43db-953c-e5f722a55581 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:16.077953 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb3ed3fc-1425-43db-953c-e5f722a55581 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:16.078756 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb3ed3fc-1425-43db-953c-e5f722a55581 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:16.079347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb3ed3fc-1425-43db-953c-e5f722a55581 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:16.080050 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb3ed3fc-1425-43db-953c-e5f722a55581 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:16.081042 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb3ed3fc-1425-43db-953c-e5f722a55581 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:16.081604 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb3ed3fc-1425-43db-953c-e5f722a55581 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:16.199786 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bb3ed3fc-1425-43db-953c-e5f722a55581 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:16.208409 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bb3ed3fc-1425-43db-953c-e5f722a55581 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1253 microversion: 2.1 time: 0.146163 Sep 13 07:03:16.209250 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 150/280] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:16 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1253 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:16.214481 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7f7ccd96-ab25-446f-a298-36a7e497a99d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:16.215330 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7f7ccd96-ab25-446f-a298-36a7e497a99d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:16.222114 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7f7ccd96-ab25-446f-a298-36a7e497a99d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:16.222794 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7f7ccd96-ab25-446f-a298-36a7e497a99d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:16.223445 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7f7ccd96-ab25-446f-a298-36a7e497a99d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:16.224363 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7f7ccd96-ab25-446f-a298-36a7e497a99d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:16.225006 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7f7ccd96-ab25-446f-a298-36a7e497a99d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:16.225640 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7f7ccd96-ab25-446f-a298-36a7e497a99d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:16.331127 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-178442bc-fa57-42c9-92d8-68b95c0c0b1a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:16.343377 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-178442bc-fa57-42c9-92d8-68b95c0c0b1a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1507 microversion: 2.1 time: 0.301675 Sep 13 07:03:16.343993 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 131/281] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:16 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1507 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:16.348560 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-235fd838-6296-4aa8-a593-909d292fccea tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:16.349171 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-235fd838-6296-4aa8-a593-909d292fccea tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:16.357877 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-235fd838-6296-4aa8-a593-909d292fccea tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:16.359342 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-235fd838-6296-4aa8-a593-909d292fccea tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:16.359890 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-235fd838-6296-4aa8-a593-909d292fccea tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:16.366462 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-235fd838-6296-4aa8-a593-909d292fccea tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:16.367018 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-235fd838-6296-4aa8-a593-909d292fccea tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:16.367677 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-235fd838-6296-4aa8-a593-909d292fccea tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:16.456008 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7f7ccd96-ab25-446f-a298-36a7e497a99d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:16.465748 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-235fd838-6296-4aa8-a593-909d292fccea tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:16.466523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7f7ccd96-ab25-446f-a298-36a7e497a99d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:16.467996 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7f7ccd96-ab25-446f-a298-36a7e497a99d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:16.469404 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7f7ccd96-ab25-446f-a298-36a7e497a99d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1723 microversion: 2.20 time: 0.258944 Sep 13 07:03:16.470797 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 151/282] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:16 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:03:16.478535 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-235fd838-6296-4aa8-a593-909d292fccea tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1291 microversion: 2.1 time: 0.133394 Sep 13 07:03:16.490328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 132/283] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:16 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1291 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:17.236100 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-66c3b060-f4ae-4ec5-aa8a-db27bb9450d9 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:17.237453 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-66c3b060-f4ae-4ec5-aa8a-db27bb9450d9 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:17.252830 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-66c3b060-f4ae-4ec5-aa8a-db27bb9450d9 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:17.254999 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-66c3b060-f4ae-4ec5-aa8a-db27bb9450d9 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:17.257564 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-66c3b060-f4ae-4ec5-aa8a-db27bb9450d9 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:17.258618 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-66c3b060-f4ae-4ec5-aa8a-db27bb9450d9 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:17.259447 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-66c3b060-f4ae-4ec5-aa8a-db27bb9450d9 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:17.260070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-66c3b060-f4ae-4ec5-aa8a-db27bb9450d9 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:17.371713 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9d54fe07-b98e-41d9-9070-61a8bb4a2a54 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:17.373039 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9d54fe07-b98e-41d9-9070-61a8bb4a2a54 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:17.381667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d54fe07-b98e-41d9-9070-61a8bb4a2a54 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:17.382540 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d54fe07-b98e-41d9-9070-61a8bb4a2a54 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:17.383131 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d54fe07-b98e-41d9-9070-61a8bb4a2a54 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:17.387324 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-66c3b060-f4ae-4ec5-aa8a-db27bb9450d9 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:17.395956 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-66c3b060-f4ae-4ec5-aa8a-db27bb9450d9 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1309 microversion: 2.1 time: 0.164436 Sep 13 07:03:17.410377 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d54fe07-b98e-41d9-9070-61a8bb4a2a54 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:17.411113 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d54fe07-b98e-41d9-9070-61a8bb4a2a54 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:17.411611 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d54fe07-b98e-41d9-9070-61a8bb4a2a54 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:17.416017 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 152/284] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:17 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1309 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:17.497734 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-27905c37-0c66-4893-90b1-a16c842625e9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:17.498309 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-27905c37-0c66-4893-90b1-a16c842625e9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:17.505390 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-27905c37-0c66-4893-90b1-a16c842625e9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:17.506070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-27905c37-0c66-4893-90b1-a16c842625e9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:17.507065 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-27905c37-0c66-4893-90b1-a16c842625e9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:17.507827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-27905c37-0c66-4893-90b1-a16c842625e9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:17.508285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-27905c37-0c66-4893-90b1-a16c842625e9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:17.508746 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-27905c37-0c66-4893-90b1-a16c842625e9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:17.640068 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9d54fe07-b98e-41d9-9070-61a8bb4a2a54 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:17.654838 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9d54fe07-b98e-41d9-9070-61a8bb4a2a54 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1507 microversion: 2.1 time: 0.287226 Sep 13 07:03:17.655526 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 133/285] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:17 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1507 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:03:17.662416 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-23428349-7428-470a-b070-d62fb054e0c9 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:17.663336 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-23428349-7428-470a-b070-d62fb054e0c9 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:17.672183 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23428349-7428-470a-b070-d62fb054e0c9 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:17.673212 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23428349-7428-470a-b070-d62fb054e0c9 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:17.674051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23428349-7428-470a-b070-d62fb054e0c9 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:17.675065 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23428349-7428-470a-b070-d62fb054e0c9 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:17.677597 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23428349-7428-470a-b070-d62fb054e0c9 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:17.678280 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23428349-7428-470a-b070-d62fb054e0c9 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:17.780603 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-23428349-7428-470a-b070-d62fb054e0c9 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:17.791879 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-23428349-7428-470a-b070-d62fb054e0c9 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1297 microversion: 2.1 time: 0.134928 Sep 13 07:03:17.792465 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 134/286] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:17 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1297 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:17.825793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-27905c37-0c66-4893-90b1-a16c842625e9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:17.839023 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-27905c37-0c66-4893-90b1-a16c842625e9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:17.840599 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-27905c37-0c66-4893-90b1-a16c842625e9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:17.841872 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-27905c37-0c66-4893-90b1-a16c842625e9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1723 microversion: 2.20 time: 0.348822 Sep 13 07:03:17.842881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 153/287] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:17 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1723 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:03:18.423889 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ef366f57-b0cf-48b6-ba31-659a8be911a2 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:18.424506 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ef366f57-b0cf-48b6-ba31-659a8be911a2 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:18.440458 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ef366f57-b0cf-48b6-ba31-659a8be911a2 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:18.441304 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ef366f57-b0cf-48b6-ba31-659a8be911a2 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:18.441898 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ef366f57-b0cf-48b6-ba31-659a8be911a2 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:18.442824 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ef366f57-b0cf-48b6-ba31-659a8be911a2 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:18.443274 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ef366f57-b0cf-48b6-ba31-659a8be911a2 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:18.443700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ef366f57-b0cf-48b6-ba31-659a8be911a2 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:18.583416 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ef366f57-b0cf-48b6-ba31-659a8be911a2 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:18.601373 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ef366f57-b0cf-48b6-ba31-659a8be911a2 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1315 microversion: 2.1 time: 0.181340 Sep 13 07:03:18.602291 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 135/288] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:18 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:18.701021 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-85ce4775-86bc-402b-b12c-318992b8affb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:18.701021 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-85ce4775-86bc-402b-b12c-318992b8affb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:18.710486 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85ce4775-86bc-402b-b12c-318992b8affb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:18.716151 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85ce4775-86bc-402b-b12c-318992b8affb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:18.719087 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85ce4775-86bc-402b-b12c-318992b8affb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:18.721469 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85ce4775-86bc-402b-b12c-318992b8affb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:18.723156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85ce4775-86bc-402b-b12c-318992b8affb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:18.724039 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85ce4775-86bc-402b-b12c-318992b8affb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:18.816388 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-066deee6-79f0-44f8-8bff-27cf95381a0e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:18.817427 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-066deee6-79f0-44f8-8bff-27cf95381a0e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:18.825946 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-066deee6-79f0-44f8-8bff-27cf95381a0e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:18.826858 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-066deee6-79f0-44f8-8bff-27cf95381a0e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:18.827494 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-066deee6-79f0-44f8-8bff-27cf95381a0e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:18.828575 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-066deee6-79f0-44f8-8bff-27cf95381a0e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:18.829245 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-066deee6-79f0-44f8-8bff-27cf95381a0e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:18.829933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-066deee6-79f0-44f8-8bff-27cf95381a0e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:19.124443 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-85ce4775-86bc-402b-b12c-318992b8affb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:19.147361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-85ce4775-86bc-402b-b12c-318992b8affb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1507 microversion: 2.1 time: 0.450433 Sep 13 07:03:19.162116 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 154/289] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:18 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1507 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:19.169110 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4dc91250-f452-47f1-a2ea-8b543d500985 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:19.170554 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4dc91250-f452-47f1-a2ea-8b543d500985 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:19.186007 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4dc91250-f452-47f1-a2ea-8b543d500985 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:19.186567 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4dc91250-f452-47f1-a2ea-8b543d500985 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:19.187039 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4dc91250-f452-47f1-a2ea-8b543d500985 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:19.187721 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-066deee6-79f0-44f8-8bff-27cf95381a0e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:19.187857 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4dc91250-f452-47f1-a2ea-8b543d500985 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:19.188213 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4dc91250-f452-47f1-a2ea-8b543d500985 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:19.188625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4dc91250-f452-47f1-a2ea-8b543d500985 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:19.196137 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-066deee6-79f0-44f8-8bff-27cf95381a0e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1364 microversion: 2.1 time: 0.384240 Sep 13 07:03:19.196731 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 136/290] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:18 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1364 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:03:19.387764 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4dc91250-f452-47f1-a2ea-8b543d500985 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:19.397457 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4dc91250-f452-47f1-a2ea-8b543d500985 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:19.398942 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4dc91250-f452-47f1-a2ea-8b543d500985 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:19.400190 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4dc91250-f452-47f1-a2ea-8b543d500985 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1723 microversion: 2.20 time: 0.246885 Sep 13 07:03:19.408087 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 155/291] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:19 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:03:19.633536 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1b13ce95-60ed-4303-b84b-c91aeeec75fd tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:19.634670 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1b13ce95-60ed-4303-b84b-c91aeeec75fd tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:19.645353 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1b13ce95-60ed-4303-b84b-c91aeeec75fd tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:19.646273 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1b13ce95-60ed-4303-b84b-c91aeeec75fd tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:19.647098 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1b13ce95-60ed-4303-b84b-c91aeeec75fd tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:19.648035 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1b13ce95-60ed-4303-b84b-c91aeeec75fd tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:19.648558 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1b13ce95-60ed-4303-b84b-c91aeeec75fd tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:19.648979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1b13ce95-60ed-4303-b84b-c91aeeec75fd tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:19.719079 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1b13ce95-60ed-4303-b84b-c91aeeec75fd tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:19.726806 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1b13ce95-60ed-4303-b84b-c91aeeec75fd tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1315 microversion: 2.1 time: 0.099647 Sep 13 07:03:19.727362 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 137/292] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:19 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1315 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:20.176326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8d4b9085-4f9c-4da1-8347-bc5f79dd9284 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:20.178010 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8d4b9085-4f9c-4da1-8347-bc5f79dd9284 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:20.199302 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d4b9085-4f9c-4da1-8347-bc5f79dd9284 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:20.201929 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d4b9085-4f9c-4da1-8347-bc5f79dd9284 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:20.202416 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d4b9085-4f9c-4da1-8347-bc5f79dd9284 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:20.203399 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d4b9085-4f9c-4da1-8347-bc5f79dd9284 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:20.204098 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d4b9085-4f9c-4da1-8347-bc5f79dd9284 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:20.204732 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d4b9085-4f9c-4da1-8347-bc5f79dd9284 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:20.225366 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-627af612-52e4-4e38-b0d9-06b2f3a4f23c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:20.226036 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-627af612-52e4-4e38-b0d9-06b2f3a4f23c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:20.235695 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-627af612-52e4-4e38-b0d9-06b2f3a4f23c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:20.236187 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-627af612-52e4-4e38-b0d9-06b2f3a4f23c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:20.236613 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-627af612-52e4-4e38-b0d9-06b2f3a4f23c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:20.241330 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-627af612-52e4-4e38-b0d9-06b2f3a4f23c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:20.241812 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-627af612-52e4-4e38-b0d9-06b2f3a4f23c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:20.242284 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-627af612-52e4-4e38-b0d9-06b2f3a4f23c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:20.701867 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-627af612-52e4-4e38-b0d9-06b2f3a4f23c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:20.711866 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-627af612-52e4-4e38-b0d9-06b2f3a4f23c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1364 microversion: 2.1 time: 0.490766 Sep 13 07:03:20.726153 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8d4b9085-4f9c-4da1-8347-bc5f79dd9284 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:20.726153 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8d4b9085-4f9c-4da1-8347-bc5f79dd9284 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1507 microversion: 2.1 time: 0.553415 Sep 13 07:03:20.726486 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 156/293] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:20 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1507 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:20.726946 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 138/294] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:20 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1364 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:20.731037 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-92431b39-7168-4874-9e0c-9a5c7c2a620d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:20.731713 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-92431b39-7168-4874-9e0c-9a5c7c2a620d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:20.737792 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-92431b39-7168-4874-9e0c-9a5c7c2a620d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:20.739111 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-92431b39-7168-4874-9e0c-9a5c7c2a620d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:20.739614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-92431b39-7168-4874-9e0c-9a5c7c2a620d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:20.740370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-92431b39-7168-4874-9e0c-9a5c7c2a620d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:20.740991 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-92431b39-7168-4874-9e0c-9a5c7c2a620d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:20.741384 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-92431b39-7168-4874-9e0c-9a5c7c2a620d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:20.749633 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-71af896b-0c44-444f-ac14-fc046fff41fe tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:20.753510 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-71af896b-0c44-444f-ac14-fc046fff41fe tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:20.770796 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-71af896b-0c44-444f-ac14-fc046fff41fe tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:20.771241 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-71af896b-0c44-444f-ac14-fc046fff41fe tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:20.771664 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-71af896b-0c44-444f-ac14-fc046fff41fe tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:20.772660 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-71af896b-0c44-444f-ac14-fc046fff41fe tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:20.773300 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-71af896b-0c44-444f-ac14-fc046fff41fe tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:20.774001 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-71af896b-0c44-444f-ac14-fc046fff41fe tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:20.937171 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-71af896b-0c44-444f-ac14-fc046fff41fe tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:20.953451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-71af896b-0c44-444f-ac14-fc046fff41fe tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1315 microversion: 2.1 time: 0.207614 Sep 13 07:03:20.954228 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 139/295] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:20 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:21.202490 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-92431b39-7168-4874-9e0c-9a5c7c2a620d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:21.213192 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-92431b39-7168-4874-9e0c-9a5c7c2a620d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:21.215262 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-92431b39-7168-4874-9e0c-9a5c7c2a620d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:21.216800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-92431b39-7168-4874-9e0c-9a5c7c2a620d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1723 microversion: 2.20 time: 0.489448 Sep 13 07:03:21.217506 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 157/296] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:20 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1723 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:03:21.737226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c9b478bb-1127-4636-9d58-8bc5eae28fed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:21.737851 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c9b478bb-1127-4636-9d58-8bc5eae28fed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:21.751322 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-06edeb55-e6f6-4345-8f8f-07ec90cbedd5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:21.752403 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-06edeb55-e6f6-4345-8f8f-07ec90cbedd5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:21.759864 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c9b478bb-1127-4636-9d58-8bc5eae28fed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:21.763048 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c9b478bb-1127-4636-9d58-8bc5eae28fed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:21.767848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06edeb55-e6f6-4345-8f8f-07ec90cbedd5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:21.768789 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c9b478bb-1127-4636-9d58-8bc5eae28fed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:21.769730 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06edeb55-e6f6-4345-8f8f-07ec90cbedd5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:21.770703 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06edeb55-e6f6-4345-8f8f-07ec90cbedd5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:21.772273 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c9b478bb-1127-4636-9d58-8bc5eae28fed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:21.773374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06edeb55-e6f6-4345-8f8f-07ec90cbedd5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:21.773807 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06edeb55-e6f6-4345-8f8f-07ec90cbedd5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:21.775873 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c9b478bb-1127-4636-9d58-8bc5eae28fed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:21.776715 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c9b478bb-1127-4636-9d58-8bc5eae28fed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:21.777398 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06edeb55-e6f6-4345-8f8f-07ec90cbedd5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:22.565318 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c9b478bb-1127-4636-9d58-8bc5eae28fed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:22.575129 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c9b478bb-1127-4636-9d58-8bc5eae28fed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1364 microversion: 2.1 time: 0.842107 Sep 13 07:03:22.594446 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 140/297] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:21 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1364 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:22.601284 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-9be04c62-1902-4100-9f09-95719f04efd4 req-46c43164-e028-4169-bb71-947c27e4ca49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e9c0b75-cd49-4a40-bd4c-24ab750fd439", "tag": "db48239f-b745-42d1-9812-35356ecdcc86"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:03:22.624532 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-9be04c62-1902-4100-9f09-95719f04efd4 req-46c43164-e028-4169-bb71-947c27e4ca49 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:22.625007 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-9be04c62-1902-4100-9f09-95719f04efd4 req-46c43164-e028-4169-bb71-947c27e4ca49 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:22.626152 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-9be04c62-1902-4100-9f09-95719f04efd4 req-46c43164-e028-4169-bb71-947c27e4ca49 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:22.644160 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-9be04c62-1902-4100-9f09-95719f04efd4 req-46c43164-e028-4169-bb71-947c27e4ca49 service nova] Creating event network-changed:db48239f-b745-42d1-9812-35356ecdcc86 for instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 on hv-cinder-85694 Sep 13 07:03:22.647675 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-06edeb55-e6f6-4345-8f8f-07ec90cbedd5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:22.661532 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-9be04c62-1902-4100-9f09-95719f04efd4 req-46c43164-e028-4169-bb71-947c27e4ca49 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064005 Sep 13 07:03:22.662319 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-06edeb55-e6f6-4345-8f8f-07ec90cbedd5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1513 microversion: 2.1 time: 0.914661 Sep 13 07:03:22.663138 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 141/298] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:03:22.663956 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 158/299] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:21 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1513 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:03:22.679080 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-49c02895-21ff-40ce-89ec-d6fc6b1a3bbf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:22.679971 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-49c02895-21ff-40ce-89ec-d6fc6b1a3bbf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:22.680497 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-fe30177a-a837-441c-b225-d56684e4f104 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:22.683131 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-fe30177a-a837-441c-b225-d56684e4f104 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:22.694771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49c02895-21ff-40ce-89ec-d6fc6b1a3bbf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:22.700210 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49c02895-21ff-40ce-89ec-d6fc6b1a3bbf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:22.701058 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fe30177a-a837-441c-b225-d56684e4f104 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:22.702530 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49c02895-21ff-40ce-89ec-d6fc6b1a3bbf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:22.703977 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fe30177a-a837-441c-b225-d56684e4f104 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:22.705060 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fe30177a-a837-441c-b225-d56684e4f104 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:22.705705 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49c02895-21ff-40ce-89ec-d6fc6b1a3bbf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:22.707061 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49c02895-21ff-40ce-89ec-d6fc6b1a3bbf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:22.707639 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fe30177a-a837-441c-b225-d56684e4f104 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:22.708598 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fe30177a-a837-441c-b225-d56684e4f104 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:22.709298 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49c02895-21ff-40ce-89ec-d6fc6b1a3bbf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:22.711192 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fe30177a-a837-441c-b225-d56684e4f104 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:22.764330 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:23.239881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-49c02895-21ff-40ce-89ec-d6fc6b1a3bbf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:23.249211 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-49c02895-21ff-40ce-89ec-d6fc6b1a3bbf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:23.250679 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-49c02895-21ff-40ce-89ec-d6fc6b1a3bbf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:23.251960 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-49c02895-21ff-40ce-89ec-d6fc6b1a3bbf tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1723 microversion: 2.20 time: 0.585222 Sep 13 07:03:23.266542 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 159/300] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:22 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1723 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:03:23.345317 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-fe30177a-a837-441c-b225-d56684e4f104 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:23.354899 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-fe30177a-a837-441c-b225-d56684e4f104 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1357 microversion: 2.1 time: 0.688602 Sep 13 07:03:23.360488 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 142/301] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:22 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1357 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:23.601907 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c6ecbb21-c19d-4f5f-96d6-dfd93d5b71db tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:23.602940 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c6ecbb21-c19d-4f5f-96d6-dfd93d5b71db tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:23.609911 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6ecbb21-c19d-4f5f-96d6-dfd93d5b71db tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:23.611011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6ecbb21-c19d-4f5f-96d6-dfd93d5b71db tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:23.611658 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6ecbb21-c19d-4f5f-96d6-dfd93d5b71db tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:23.612647 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6ecbb21-c19d-4f5f-96d6-dfd93d5b71db tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:23.613976 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6ecbb21-c19d-4f5f-96d6-dfd93d5b71db tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:23.614687 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6ecbb21-c19d-4f5f-96d6-dfd93d5b71db tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:23.800430 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:23.818736 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c6ecbb21-c19d-4f5f-96d6-dfd93d5b71db tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:23.826586 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c6ecbb21-c19d-4f5f-96d6-dfd93d5b71db tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1364 microversion: 2.1 time: 0.228717 Sep 13 07:03:23.827147 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 160/302] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:23 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:24.287924 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5af51c22-0671-4f2d-ae6a-530aa70d22f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:24.288912 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5af51c22-0671-4f2d-ae6a-530aa70d22f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:24.300569 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5af51c22-0671-4f2d-ae6a-530aa70d22f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:24.301787 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5af51c22-0671-4f2d-ae6a-530aa70d22f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:24.302326 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5af51c22-0671-4f2d-ae6a-530aa70d22f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:24.303213 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5af51c22-0671-4f2d-ae6a-530aa70d22f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:24.304287 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5af51c22-0671-4f2d-ae6a-530aa70d22f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:24.305223 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5af51c22-0671-4f2d-ae6a-530aa70d22f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:24.393963 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-00ac6c65-c105-4d60-b242-233bf58aac01 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:24.395396 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-00ac6c65-c105-4d60-b242-233bf58aac01 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:24.419554 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=12 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:24.441297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00ac6c65-c105-4d60-b242-233bf58aac01 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:24.442216 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00ac6c65-c105-4d60-b242-233bf58aac01 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:24.443492 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00ac6c65-c105-4d60-b242-233bf58aac01 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:24.445844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00ac6c65-c105-4d60-b242-233bf58aac01 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:24.448537 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00ac6c65-c105-4d60-b242-233bf58aac01 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:24.450584 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00ac6c65-c105-4d60-b242-233bf58aac01 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:24.699834 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:24.847960 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5af51c22-0671-4f2d-ae6a-530aa70d22f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:24.858023 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5af51c22-0671-4f2d-ae6a-530aa70d22f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:24.868198 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5af51c22-0671-4f2d-ae6a-530aa70d22f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:24.877662 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5af51c22-0671-4f2d-ae6a-530aa70d22f2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1744 microversion: 2.20 time: 0.600098 Sep 13 07:03:24.878582 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 143/303] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:24 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1744 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:03:24.883568 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b760287a-90db-4810-a8bb-6d076184edb3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Action: 'create', calling method: .version_select at 0x7f4c197da550>, body: {"keypair": {"name": "tempest-keypair-1721147787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtg5ziA+iRmYHE17HSJOCVC0K/CngWS2ElWimpb7EYAnVKo57ouSDorq85Mvof2hjngO+LeWwx+jcOEaP8PTmoFF0IPhlW0C6TSiEuLPFcPLZ0R4KxJxERd7L2dO6HKiw=="}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:03:24.932410 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-b760287a-90db-4810-a8bb-6d076184edb3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Getting quotas for project 38b6d7b146a34896bb8309e2c51348f8. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:03:24.957411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-b760287a-90db-4810-a8bb-6d076184edb3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Getting quotas for user 0d8d0ff010c04d65b36ebe65c1cbbbfd and project 38b6d7b146a34896bb8309e2c51348f8. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:03:24.976823 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-00ac6c65-c105-4d60-b242-233bf58aac01 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:24.985851 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-00ac6c65-c105-4d60-b242-233bf58aac01 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1357 microversion: 2.1 time: 0.599621 Sep 13 07:03:24.989572 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 161/304] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:24 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1357 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:24.996010 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-1b6916d4-1206-4d42-be81-61262019f8f8 req-36bb3f9f-4513-44bd-b383-d8dfa34bcf3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64680760-9370-4f3b-acc5-0ed7d1796015", "tag": "1e7460cd-303f-44c8-b234-3c2f83c1e238"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:03:25.013413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-1b6916d4-1206-4d42-be81-61262019f8f8 req-36bb3f9f-4513-44bd-b383-d8dfa34bcf3c service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:25.014522 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-1b6916d4-1206-4d42-be81-61262019f8f8 req-36bb3f9f-4513-44bd-b383-d8dfa34bcf3c service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:25.015293 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-1b6916d4-1206-4d42-be81-61262019f8f8 req-36bb3f9f-4513-44bd-b383-d8dfa34bcf3c service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:25.018613 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b760287a-90db-4810-a8bb-6d076184edb3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.138710 Sep 13 07:03:25.022154 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 144/305] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Sep 13 07:03:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:03:25.024538 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-803b54cf-6382-4566-a066-926021300736 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:25.038404 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-803b54cf-6382-4566-a066-926021300736 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:25.044835 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-803b54cf-6382-4566-a066-926021300736 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:25.045327 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-803b54cf-6382-4566-a066-926021300736 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:25.045754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-803b54cf-6382-4566-a066-926021300736 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:25.047277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-803b54cf-6382-4566-a066-926021300736 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:25.047963 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-803b54cf-6382-4566-a066-926021300736 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:25.048531 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-803b54cf-6382-4566-a066-926021300736 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:25.053216 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=100 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:25.059144 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-1b6916d4-1206-4d42-be81-61262019f8f8 req-36bb3f9f-4513-44bd-b383-d8dfa34bcf3c service nova] Creating event network-changed:1e7460cd-303f-44c8-b234-3c2f83c1e238 for instance 64680760-9370-4f3b-acc5-0ed7d1796015 on hv-cinder-85694 Sep 13 07:03:25.070339 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-1b6916d4-1206-4d42-be81-61262019f8f8 req-36bb3f9f-4513-44bd-b383-d8dfa34bcf3c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079122 Sep 13 07:03:25.073158 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 162/306] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:03:25.301539 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-803b54cf-6382-4566-a066-926021300736 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:25.314754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-803b54cf-6382-4566-a066-926021300736 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1364 microversion: 2.1 time: 0.293278 Sep 13 07:03:25.326796 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 145/307] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:25 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1364 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:25.905547 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6d943b6a-d6ba-4b1c-a965-d28279979a1f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:25.906284 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6d943b6a-d6ba-4b1c-a965-d28279979a1f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:25.914279 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6d943b6a-d6ba-4b1c-a965-d28279979a1f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:25.915184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6d943b6a-d6ba-4b1c-a965-d28279979a1f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:25.916629 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6d943b6a-d6ba-4b1c-a965-d28279979a1f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:25.917880 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6d943b6a-d6ba-4b1c-a965-d28279979a1f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:25.918937 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6d943b6a-d6ba-4b1c-a965-d28279979a1f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:25.919810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6d943b6a-d6ba-4b1c-a965-d28279979a1f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:26.023132 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4561c5f9-54ca-44b9-908f-3c7d43150746 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:26.023761 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4561c5f9-54ca-44b9-908f-3c7d43150746 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:26.039033 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4561c5f9-54ca-44b9-908f-3c7d43150746 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:26.040125 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4561c5f9-54ca-44b9-908f-3c7d43150746 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:26.040809 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4561c5f9-54ca-44b9-908f-3c7d43150746 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:26.041890 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4561c5f9-54ca-44b9-908f-3c7d43150746 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:26.042616 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4561c5f9-54ca-44b9-908f-3c7d43150746 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:26.043427 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4561c5f9-54ca-44b9-908f-3c7d43150746 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:26.229155 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6d943b6a-d6ba-4b1c-a965-d28279979a1f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:26.242703 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6d943b6a-d6ba-4b1c-a965-d28279979a1f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:26.244636 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6d943b6a-d6ba-4b1c-a965-d28279979a1f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:26.245873 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6d943b6a-d6ba-4b1c-a965-d28279979a1f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1744 microversion: 2.20 time: 0.344643 Sep 13 07:03:26.251584 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 163/308] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:25 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1744 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:03:26.341413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b5fffab7-7de4-4ccd-a80b-0ee51e6e7618 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:26.342431 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b5fffab7-7de4-4ccd-a80b-0ee51e6e7618 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:26.353850 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5fffab7-7de4-4ccd-a80b-0ee51e6e7618 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:26.355929 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5fffab7-7de4-4ccd-a80b-0ee51e6e7618 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:26.358015 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5fffab7-7de4-4ccd-a80b-0ee51e6e7618 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:26.359014 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5fffab7-7de4-4ccd-a80b-0ee51e6e7618 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:26.359685 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5fffab7-7de4-4ccd-a80b-0ee51e6e7618 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:26.360412 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5fffab7-7de4-4ccd-a80b-0ee51e6e7618 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:26.364126 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4561c5f9-54ca-44b9-908f-3c7d43150746 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:26.372929 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4561c5f9-54ca-44b9-908f-3c7d43150746 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1357 microversion: 2.1 time: 0.360282 Sep 13 07:03:26.373532 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 146/309] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:26 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1357 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:26.629766 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b5fffab7-7de4-4ccd-a80b-0ee51e6e7618 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:26.645750 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b5fffab7-7de4-4ccd-a80b-0ee51e6e7618 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1364 microversion: 2.1 time: 0.308969 Sep 13 07:03:26.646629 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 164/310] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:26 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1364 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:03:27.014552 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-611c8c45-464e-413e-8ed7-1c55854bd4cc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-265467119", "imageRef": "19a6700e-e153-4bea-87aa-036bfccf0ecd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "79887e4b-b2f3-4f20-8c5f-af8dc11d6f75"}], "security_groups": [{"name": "tempest-securitygroup--1260060378"}], "key_name": "tempest-keypair-1721147787", "user_data": "}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:03:27.276629 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2d181107-815d-4d03-961b-2fec49020e58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:27.277207 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2d181107-815d-4d03-961b-2fec49020e58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:27.284165 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d181107-815d-4d03-961b-2fec49020e58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:27.284648 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d181107-815d-4d03-961b-2fec49020e58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:27.285078 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d181107-815d-4d03-961b-2fec49020e58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:27.285771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d181107-815d-4d03-961b-2fec49020e58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:27.286249 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d181107-815d-4d03-961b-2fec49020e58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:27.286667 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d181107-815d-4d03-961b-2fec49020e58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:27.788054 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2d181107-815d-4d03-961b-2fec49020e58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:27.798259 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2d181107-815d-4d03-961b-2fec49020e58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:27.799883 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2d181107-815d-4d03-961b-2fec49020e58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:27.801398 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2d181107-815d-4d03-961b-2fec49020e58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1739 microversion: 2.20 time: 0.529085 Sep 13 07:03:27.802207 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 165/311] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:27 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1739 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:03:27.824069 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ea3c9564-677a-4473-bc66-73b4a2808c28 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:27.825307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ea3c9564-677a-4473-bc66-73b4a2808c28 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:27.840516 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea3c9564-677a-4473-bc66-73b4a2808c28 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:27.841324 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea3c9564-677a-4473-bc66-73b4a2808c28 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:27.841915 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea3c9564-677a-4473-bc66-73b4a2808c28 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:27.842821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea3c9564-677a-4473-bc66-73b4a2808c28 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:27.844196 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea3c9564-677a-4473-bc66-73b4a2808c28 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:27.845398 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea3c9564-677a-4473-bc66-73b4a2808c28 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:28.052765 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ea3c9564-677a-4473-bc66-73b4a2808c28 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:28.064878 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ea3c9564-677a-4473-bc66-73b4a2808c28 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1357 microversion: 2.1 time: 0.248369 Sep 13 07:03:28.065747 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 166/312] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:27 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1357 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:28.070858 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b31a993a-3b9b-42a5-aed2-d57baeddada6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:28.071889 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b31a993a-3b9b-42a5-aed2-d57baeddada6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:28.102601 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b31a993a-3b9b-42a5-aed2-d57baeddada6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:28.104458 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b31a993a-3b9b-42a5-aed2-d57baeddada6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:28.105219 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b31a993a-3b9b-42a5-aed2-d57baeddada6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:28.107651 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b31a993a-3b9b-42a5-aed2-d57baeddada6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:28.109228 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b31a993a-3b9b-42a5-aed2-d57baeddada6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:28.114763 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b31a993a-3b9b-42a5-aed2-d57baeddada6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:28.381325 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b31a993a-3b9b-42a5-aed2-d57baeddada6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:28.404722 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b31a993a-3b9b-42a5-aed2-d57baeddada6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1364 microversion: 2.1 time: 0.333697 Sep 13 07:03:28.405381 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 167/313] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:28 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1364 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:28.414381 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-0e1ec669-ed54-4fd7-8a59-e2035f3aede6 req-a4e19406-c4a9-499d-b1c5-a74065168a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d57882a-892f-4b45-a8ec-7b6f4b21b0ad", "name": "network-vif-plugged", "status": "completed", "tag": "447e368f-71d6-49ce-be81-226ee22458f1"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:03:28.436480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0e1ec669-ed54-4fd7-8a59-e2035f3aede6 req-a4e19406-c4a9-499d-b1c5-a74065168a3a service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:28.436954 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0e1ec669-ed54-4fd7-8a59-e2035f3aede6 req-a4e19406-c4a9-499d-b1c5-a74065168a3a service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:28.437389 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0e1ec669-ed54-4fd7-8a59-e2035f3aede6 req-a4e19406-c4a9-499d-b1c5-a74065168a3a service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:28.468370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-0e1ec669-ed54-4fd7-8a59-e2035f3aede6 req-a4e19406-c4a9-499d-b1c5-a74065168a3a service nova] Creating event network-vif-plugged:447e368f-71d6-49ce-be81-226ee22458f1 for instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad on hv-cinder-85694 Sep 13 07:03:28.474528 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-0e1ec669-ed54-4fd7-8a59-e2035f3aede6 req-a4e19406-c4a9-499d-b1c5-a74065168a3a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065140 Sep 13 07:03:28.483184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 168/314] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:03:28.833448 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b7295eee-5a43-4648-bee9-a3ec753e1b8b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:28.834284 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b7295eee-5a43-4648-bee9-a3ec753e1b8b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:28.840795 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b7295eee-5a43-4648-bee9-a3ec753e1b8b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:28.841269 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b7295eee-5a43-4648-bee9-a3ec753e1b8b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:28.841688 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b7295eee-5a43-4648-bee9-a3ec753e1b8b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:28.842406 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b7295eee-5a43-4648-bee9-a3ec753e1b8b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:28.842849 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b7295eee-5a43-4648-bee9-a3ec753e1b8b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:28.843259 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b7295eee-5a43-4648-bee9-a3ec753e1b8b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:28.992996 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b7295eee-5a43-4648-bee9-a3ec753e1b8b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:29.003518 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b7295eee-5a43-4648-bee9-a3ec753e1b8b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:29.006050 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b7295eee-5a43-4648-bee9-a3ec753e1b8b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:29.007710 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b7295eee-5a43-4648-bee9-a3ec753e1b8b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1739 microversion: 2.20 time: 0.178649 Sep 13 07:03:29.008423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 169/315] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:28 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:03:29.093694 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-22f70a4c-8537-415c-9fbc-86ea81ef5a8d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:29.094346 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-22f70a4c-8537-415c-9fbc-86ea81ef5a8d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:29.106952 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-22f70a4c-8537-415c-9fbc-86ea81ef5a8d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:29.107872 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-22f70a4c-8537-415c-9fbc-86ea81ef5a8d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:29.108596 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-22f70a4c-8537-415c-9fbc-86ea81ef5a8d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:29.109482 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-22f70a4c-8537-415c-9fbc-86ea81ef5a8d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:29.110123 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-22f70a4c-8537-415c-9fbc-86ea81ef5a8d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:29.110587 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-22f70a4c-8537-415c-9fbc-86ea81ef5a8d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:29.294422 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-22f70a4c-8537-415c-9fbc-86ea81ef5a8d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:29.302323 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-22f70a4c-8537-415c-9fbc-86ea81ef5a8d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1357 microversion: 2.1 time: 0.212661 Sep 13 07:03:29.302897 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 170/316] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:29 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:29.437603 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1729cbef-d961-45e2-b0f9-7287ee8251f3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:29.438361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1729cbef-d961-45e2-b0f9-7287ee8251f3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:29.440207 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:29.445653 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1729cbef-d961-45e2-b0f9-7287ee8251f3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:29.446134 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1729cbef-d961-45e2-b0f9-7287ee8251f3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:29.446673 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1729cbef-d961-45e2-b0f9-7287ee8251f3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:29.447843 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1729cbef-d961-45e2-b0f9-7287ee8251f3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:29.448554 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1729cbef-d961-45e2-b0f9-7287ee8251f3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:29.448878 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1729cbef-d961-45e2-b0f9-7287ee8251f3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:29.609664 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1729cbef-d961-45e2-b0f9-7287ee8251f3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:29.617961 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1729cbef-d961-45e2-b0f9-7287ee8251f3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1364 microversion: 2.1 time: 0.184222 Sep 13 07:03:29.618774 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 171/317] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:29 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:03:30.033810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bc86a037-1b28-47f8-afb9-d6722d8d3aec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:30.034730 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bc86a037-1b28-47f8-afb9-d6722d8d3aec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:30.066276 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc86a037-1b28-47f8-afb9-d6722d8d3aec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:30.066276 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc86a037-1b28-47f8-afb9-d6722d8d3aec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:30.066276 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc86a037-1b28-47f8-afb9-d6722d8d3aec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:30.066276 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc86a037-1b28-47f8-afb9-d6722d8d3aec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:30.066892 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc86a037-1b28-47f8-afb9-d6722d8d3aec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:30.066892 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc86a037-1b28-47f8-afb9-d6722d8d3aec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:30.381096 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-611c8c45-464e-413e-8ed7-1c55854bd4cc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] validate_networks() for [('79887e4b-b2f3-4f20-8c5f-af8dc11d6f75', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:03:30.390609 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bc86a037-1b28-47f8-afb9-d6722d8d3aec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:30.408021 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bc86a037-1b28-47f8-afb9-d6722d8d3aec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:30.409445 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bc86a037-1b28-47f8-afb9-d6722d8d3aec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:30.410660 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bc86a037-1b28-47f8-afb9-d6722d8d3aec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1739 microversion: 2.20 time: 0.381137 Sep 13 07:03:30.411218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 172/318] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:30 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1739 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:03:30.418798 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6dda79c0-b84e-4cb6-bf76-7ce61e74d47f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:30.419444 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6dda79c0-b84e-4cb6-bf76-7ce61e74d47f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:30.443074 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6dda79c0-b84e-4cb6-bf76-7ce61e74d47f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:30.443795 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6dda79c0-b84e-4cb6-bf76-7ce61e74d47f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:30.444191 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6dda79c0-b84e-4cb6-bf76-7ce61e74d47f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:30.444874 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6dda79c0-b84e-4cb6-bf76-7ce61e74d47f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:30.446676 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6dda79c0-b84e-4cb6-bf76-7ce61e74d47f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:30.450546 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6dda79c0-b84e-4cb6-bf76-7ce61e74d47f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:30.943895 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6dda79c0-b84e-4cb6-bf76-7ce61e74d47f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:30.952514 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6dda79c0-b84e-4cb6-bf76-7ce61e74d47f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1357 microversion: 2.1 time: 0.540224 Sep 13 07:03:30.957089 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 173/319] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:30 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1357 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:30.972864 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-fe9ce110-6edf-431e-8bad-28914a320457 req-2886c88d-c2f3-4ce9-afbd-2b7ac58570be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9c0b75-cd49-4a40-bd4c-24ab750fd439", "name": "network-vif-plugged", "status": "completed", "tag": "db48239f-b745-42d1-9812-35356ecdcc86"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:03:31.014411 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-fe9ce110-6edf-431e-8bad-28914a320457 req-2886c88d-c2f3-4ce9-afbd-2b7ac58570be service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:31.014927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-fe9ce110-6edf-431e-8bad-28914a320457 req-2886c88d-c2f3-4ce9-afbd-2b7ac58570be service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:31.015362 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-fe9ce110-6edf-431e-8bad-28914a320457 req-2886c88d-c2f3-4ce9-afbd-2b7ac58570be service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:31.038372 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-fe9ce110-6edf-431e-8bad-28914a320457 req-2886c88d-c2f3-4ce9-afbd-2b7ac58570be service nova] Creating event network-vif-plugged:db48239f-b745-42d1-9812-35356ecdcc86 for instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 on hv-cinder-85694 Sep 13 07:03:31.044614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-fe9ce110-6edf-431e-8bad-28914a320457 req-2886c88d-c2f3-4ce9-afbd-2b7ac58570be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086069 Sep 13 07:03:31.046046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 174/320] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:03:31.053335 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1568a1ef-45e1-45b9-9ef5-2c5f39dd9073 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:31.054450 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1568a1ef-45e1-45b9-9ef5-2c5f39dd9073 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:31.062210 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1568a1ef-45e1-45b9-9ef5-2c5f39dd9073 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:31.063058 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1568a1ef-45e1-45b9-9ef5-2c5f39dd9073 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:31.064078 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1568a1ef-45e1-45b9-9ef5-2c5f39dd9073 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:31.065471 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1568a1ef-45e1-45b9-9ef5-2c5f39dd9073 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:31.066172 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1568a1ef-45e1-45b9-9ef5-2c5f39dd9073 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:31.075562 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1568a1ef-45e1-45b9-9ef5-2c5f39dd9073 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:31.306984 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-611c8c45-464e-413e-8ed7-1c55854bd4cc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:03:31.307435 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-611c8c45-464e-413e-8ed7-1c55854bd4cc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:03:31.308160 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-611c8c45-464e-413e-8ed7-1c55854bd4cc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:03:31.308643 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-611c8c45-464e-413e-8ed7-1c55854bd4cc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:03:31.309048 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-611c8c45-464e-413e-8ed7-1c55854bd4cc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:03:31.328492 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-611c8c45-464e-413e-8ed7-1c55854bd4cc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:31.328974 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-611c8c45-464e-413e-8ed7-1c55854bd4cc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:31.329581 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-611c8c45-464e-413e-8ed7-1c55854bd4cc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:31.330520 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-611c8c45-464e-413e-8ed7-1c55854bd4cc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:31.331143 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-611c8c45-464e-413e-8ed7-1c55854bd4cc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:31.334671 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-611c8c45-464e-413e-8ed7-1c55854bd4cc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:31.397760 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-611c8c45-464e-413e-8ed7-1c55854bd4cc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Getting quotas for project 38b6d7b146a34896bb8309e2c51348f8. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:03:31.405936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1568a1ef-45e1-45b9-9ef5-2c5f39dd9073 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:31.415012 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1568a1ef-45e1-45b9-9ef5-2c5f39dd9073 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1364 microversion: 2.1 time: 0.367391 Sep 13 07:03:31.417370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 175/321] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:31 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1364 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:31.426027 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-611c8c45-464e-413e-8ed7-1c55854bd4cc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Getting quotas for user 0d8d0ff010c04d65b36ebe65c1cbbbfd and project 38b6d7b146a34896bb8309e2c51348f8. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:03:31.437403 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a7a2e3e2-1d91-49f6-8f44-8ce77da0aa2e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:31.438054 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a7a2e3e2-1d91-49f6-8f44-8ce77da0aa2e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:31.455203 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7a2e3e2-1d91-49f6-8f44-8ce77da0aa2e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:31.460281 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7a2e3e2-1d91-49f6-8f44-8ce77da0aa2e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:31.460942 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7a2e3e2-1d91-49f6-8f44-8ce77da0aa2e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:31.465843 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7a2e3e2-1d91-49f6-8f44-8ce77da0aa2e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:31.466553 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7a2e3e2-1d91-49f6-8f44-8ce77da0aa2e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:31.468484 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7a2e3e2-1d91-49f6-8f44-8ce77da0aa2e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:31.483404 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-611c8c45-464e-413e-8ed7-1c55854bd4cc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:03:31.490813 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-611c8c45-464e-413e-8ed7-1c55854bd4cc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='19a6700e-e153-4bea-87aa-036bfccf0ecd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:03:31.519973 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:31.664116 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-611c8c45-464e-413e-8ed7-1c55854bd4cc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 4.653818 Sep 13 07:03:31.677942 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 147/322] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Sep 13 07:03:27 2022] POST /compute/v2.1/servers => generated 409 bytes in 4667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 07:03:31.715171 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1dd236d3-e29d-47af-b04e-417677820fef tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:31.715862 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1dd236d3-e29d-47af-b04e-417677820fef tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:31.854241 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a7a2e3e2-1d91-49f6-8f44-8ce77da0aa2e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:31.863150 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a7a2e3e2-1d91-49f6-8f44-8ce77da0aa2e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:31.868251 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a7a2e3e2-1d91-49f6-8f44-8ce77da0aa2e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:31.872398 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1dd236d3-e29d-47af-b04e-417677820fef tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:31.880575 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1dd236d3-e29d-47af-b04e-417677820fef tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1245 microversion: 2.1 time: 0.192016 Sep 13 07:03:31.882751 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 148/323] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:31 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1245 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:31.894651 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a7a2e3e2-1d91-49f6-8f44-8ce77da0aa2e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1739 microversion: 2.20 time: 0.448895 Sep 13 07:03:31.896212 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 176/324] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:31 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1739 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:03:31.986791 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1f85262f-3c30-4210-8b5d-822907e12465 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:31.987715 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1f85262f-3c30-4210-8b5d-822907e12465 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:32.010006 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1f85262f-3c30-4210-8b5d-822907e12465 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:32.011793 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1f85262f-3c30-4210-8b5d-822907e12465 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:32.012605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1f85262f-3c30-4210-8b5d-822907e12465 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:32.013389 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1f85262f-3c30-4210-8b5d-822907e12465 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:32.022731 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1f85262f-3c30-4210-8b5d-822907e12465 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:32.023332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1f85262f-3c30-4210-8b5d-822907e12465 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:32.348224 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1f85262f-3c30-4210-8b5d-822907e12465 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:32.356651 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1f85262f-3c30-4210-8b5d-822907e12465 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1357 microversion: 2.1 time: 0.377232 Sep 13 07:03:32.371233 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 149/325] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:31 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1357 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:03:32.444844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1f11c394-1f09-428f-ad33-5de8bcdf72e4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:32.445475 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1f11c394-1f09-428f-ad33-5de8bcdf72e4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:32.468051 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f11c394-1f09-428f-ad33-5de8bcdf72e4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:32.468810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f11c394-1f09-428f-ad33-5de8bcdf72e4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:32.469069 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f11c394-1f09-428f-ad33-5de8bcdf72e4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:32.469844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f11c394-1f09-428f-ad33-5de8bcdf72e4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:32.470542 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f11c394-1f09-428f-ad33-5de8bcdf72e4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:32.471382 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f11c394-1f09-428f-ad33-5de8bcdf72e4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:32.670885 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1f11c394-1f09-428f-ad33-5de8bcdf72e4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:32.675164 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:32.682057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1f11c394-1f09-428f-ad33-5de8bcdf72e4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1364 microversion: 2.1 time: 0.241471 Sep 13 07:03:32.683117 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 177/326] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:32 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:32.912865 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9134c85e-41ce-4a8e-86c7-059e0110540d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:32.914914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9134c85e-41ce-4a8e-86c7-059e0110540d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:32.922330 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-16c9402c-50b9-49ff-8a55-94288e213924 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:32.923202 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-16c9402c-50b9-49ff-8a55-94288e213924 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:32.932210 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9134c85e-41ce-4a8e-86c7-059e0110540d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:32.933828 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-16c9402c-50b9-49ff-8a55-94288e213924 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:32.933975 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9134c85e-41ce-4a8e-86c7-059e0110540d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:32.934444 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9134c85e-41ce-4a8e-86c7-059e0110540d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:32.935095 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-16c9402c-50b9-49ff-8a55-94288e213924 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:32.938337 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9134c85e-41ce-4a8e-86c7-059e0110540d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:32.938827 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9134c85e-41ce-4a8e-86c7-059e0110540d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:32.939228 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-16c9402c-50b9-49ff-8a55-94288e213924 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:32.940118 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-16c9402c-50b9-49ff-8a55-94288e213924 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:32.940719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-16c9402c-50b9-49ff-8a55-94288e213924 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:32.941536 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9134c85e-41ce-4a8e-86c7-059e0110540d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:32.941912 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-16c9402c-50b9-49ff-8a55-94288e213924 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:33.074436 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9134c85e-41ce-4a8e-86c7-059e0110540d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:33.086310 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9134c85e-41ce-4a8e-86c7-059e0110540d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1249 microversion: 2.1 time: 0.179572 Sep 13 07:03:33.087613 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 150/327] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:32 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1249 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:33.321250 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-16c9402c-50b9-49ff-8a55-94288e213924 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:33.337330 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-16c9402c-50b9-49ff-8a55-94288e213924 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:33.339065 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-16c9402c-50b9-49ff-8a55-94288e213924 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:33.340359 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-16c9402c-50b9-49ff-8a55-94288e213924 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1739 microversion: 2.20 time: 0.423306 Sep 13 07:03:33.340958 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 178/328] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:32 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1739 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:03:33.382252 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d6448d8b-5667-43c6-9880-126e6e75d743 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:33.389017 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d6448d8b-5667-43c6-9880-126e6e75d743 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:33.393017 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d6448d8b-5667-43c6-9880-126e6e75d743 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:33.393433 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d6448d8b-5667-43c6-9880-126e6e75d743 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:33.393886 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d6448d8b-5667-43c6-9880-126e6e75d743 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:33.394637 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d6448d8b-5667-43c6-9880-126e6e75d743 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:33.395154 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d6448d8b-5667-43c6-9880-126e6e75d743 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:33.395576 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d6448d8b-5667-43c6-9880-126e6e75d743 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:33.611211 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d6448d8b-5667-43c6-9880-126e6e75d743 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:33.626916 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d6448d8b-5667-43c6-9880-126e6e75d743 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1357 microversion: 2.1 time: 0.249871 Sep 13 07:03:33.628618 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 151/329] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:33 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1357 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:03:33.706344 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-28fdffd5-15ba-4376-aa78-3c5ccdf12227 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:33.707112 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-28fdffd5-15ba-4376-aa78-3c5ccdf12227 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:33.717002 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-28fdffd5-15ba-4376-aa78-3c5ccdf12227 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:33.717751 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-28fdffd5-15ba-4376-aa78-3c5ccdf12227 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:33.718201 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-28fdffd5-15ba-4376-aa78-3c5ccdf12227 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:33.719139 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-28fdffd5-15ba-4376-aa78-3c5ccdf12227 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:33.719788 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-28fdffd5-15ba-4376-aa78-3c5ccdf12227 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:33.720411 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-28fdffd5-15ba-4376-aa78-3c5ccdf12227 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:33.953207 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-28fdffd5-15ba-4376-aa78-3c5ccdf12227 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:33.967553 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-28fdffd5-15ba-4376-aa78-3c5ccdf12227 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1364 microversion: 2.1 time: 0.264677 Sep 13 07:03:33.970596 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 179/330] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:33 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1364 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:34.111156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bb2765e9-c10c-4a90-bbbf-e70a77fb7708 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:34.111834 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bb2765e9-c10c-4a90-bbbf-e70a77fb7708 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:34.118575 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb2765e9-c10c-4a90-bbbf-e70a77fb7708 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:34.119064 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb2765e9-c10c-4a90-bbbf-e70a77fb7708 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:34.119660 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb2765e9-c10c-4a90-bbbf-e70a77fb7708 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:34.120371 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb2765e9-c10c-4a90-bbbf-e70a77fb7708 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:34.120926 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb2765e9-c10c-4a90-bbbf-e70a77fb7708 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:34.121213 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb2765e9-c10c-4a90-bbbf-e70a77fb7708 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:34.230167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bb2765e9-c10c-4a90-bbbf-e70a77fb7708 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:34.253129 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bb2765e9-c10c-4a90-bbbf-e70a77fb7708 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1249 microversion: 2.1 time: 0.147821 Sep 13 07:03:34.255322 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 152/331] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:34 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1249 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:34.367908 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-210f807c-ab6b-4c64-b53c-4d8a1310defa tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:34.368862 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-210f807c-ab6b-4c64-b53c-4d8a1310defa tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:34.376933 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-210f807c-ab6b-4c64-b53c-4d8a1310defa tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:34.382110 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-210f807c-ab6b-4c64-b53c-4d8a1310defa tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:34.382561 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-210f807c-ab6b-4c64-b53c-4d8a1310defa tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:34.383296 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-210f807c-ab6b-4c64-b53c-4d8a1310defa tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:34.383745 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-210f807c-ab6b-4c64-b53c-4d8a1310defa tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:34.384157 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-210f807c-ab6b-4c64-b53c-4d8a1310defa tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:34.576518 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-210f807c-ab6b-4c64-b53c-4d8a1310defa tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:34.586736 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-210f807c-ab6b-4c64-b53c-4d8a1310defa tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:34.588330 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-210f807c-ab6b-4c64-b53c-4d8a1310defa tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:34.590495 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-210f807c-ab6b-4c64-b53c-4d8a1310defa tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1739 microversion: 2.20 time: 0.226663 Sep 13 07:03:34.614858 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 180/332] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:34 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:03:34.661569 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-78cf6273-83ba-465e-9e99-f600a7eee594 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:34.664519 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-78cf6273-83ba-465e-9e99-f600a7eee594 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:34.670773 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-78cf6273-83ba-465e-9e99-f600a7eee594 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:34.671253 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-78cf6273-83ba-465e-9e99-f600a7eee594 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:34.671677 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-78cf6273-83ba-465e-9e99-f600a7eee594 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:34.672415 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-78cf6273-83ba-465e-9e99-f600a7eee594 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:34.672860 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-78cf6273-83ba-465e-9e99-f600a7eee594 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:34.673459 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-78cf6273-83ba-465e-9e99-f600a7eee594 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:34.881801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-78cf6273-83ba-465e-9e99-f600a7eee594 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:34.895668 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-78cf6273-83ba-465e-9e99-f600a7eee594 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1357 microversion: 2.1 time: 0.248604 Sep 13 07:03:34.897213 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 153/333] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:34 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1357 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:34.996087 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-aab8c191-3532-4683-90a7-c5a9e17cd1ad tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:34.997768 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-aab8c191-3532-4683-90a7-c5a9e17cd1ad tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:35.008637 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aab8c191-3532-4683-90a7-c5a9e17cd1ad tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:35.010823 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aab8c191-3532-4683-90a7-c5a9e17cd1ad tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:35.011252 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aab8c191-3532-4683-90a7-c5a9e17cd1ad tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:35.011991 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aab8c191-3532-4683-90a7-c5a9e17cd1ad tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:35.012437 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aab8c191-3532-4683-90a7-c5a9e17cd1ad tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:35.012850 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aab8c191-3532-4683-90a7-c5a9e17cd1ad tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:35.238624 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-aab8c191-3532-4683-90a7-c5a9e17cd1ad tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:35.249607 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-aab8c191-3532-4683-90a7-c5a9e17cd1ad tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1364 microversion: 2.1 time: 0.258300 Sep 13 07:03:35.257989 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 181/334] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:34 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1364 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:03:35.277753 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5e9852c8-87a5-4071-9780-8f0f13cc63b3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:35.278415 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5e9852c8-87a5-4071-9780-8f0f13cc63b3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:35.285533 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5e9852c8-87a5-4071-9780-8f0f13cc63b3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:35.286144 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5e9852c8-87a5-4071-9780-8f0f13cc63b3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:35.286779 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5e9852c8-87a5-4071-9780-8f0f13cc63b3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:35.287653 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5e9852c8-87a5-4071-9780-8f0f13cc63b3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:35.288097 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5e9852c8-87a5-4071-9780-8f0f13cc63b3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:35.288508 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5e9852c8-87a5-4071-9780-8f0f13cc63b3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:35.372598 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5e9852c8-87a5-4071-9780-8f0f13cc63b3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:35.391570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5e9852c8-87a5-4071-9780-8f0f13cc63b3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1249 microversion: 2.1 time: 0.118485 Sep 13 07:03:35.392411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 154/335] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:35 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1249 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:35.629124 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dd6c2e49-fbbc-4b03-bf7a-7462a53a123c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:35.629724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-dd6c2e49-fbbc-4b03-bf7a-7462a53a123c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:35.636987 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd6c2e49-fbbc-4b03-bf7a-7462a53a123c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:35.637476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd6c2e49-fbbc-4b03-bf7a-7462a53a123c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:35.638135 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd6c2e49-fbbc-4b03-bf7a-7462a53a123c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:35.638831 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd6c2e49-fbbc-4b03-bf7a-7462a53a123c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:35.639443 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd6c2e49-fbbc-4b03-bf7a-7462a53a123c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:35.640016 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd6c2e49-fbbc-4b03-bf7a-7462a53a123c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:35.816332 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-dd6c2e49-fbbc-4b03-bf7a-7462a53a123c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:35.827980 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-dd6c2e49-fbbc-4b03-bf7a-7462a53a123c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:35.829832 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-dd6c2e49-fbbc-4b03-bf7a-7462a53a123c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:35.831567 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dd6c2e49-fbbc-4b03-bf7a-7462a53a123c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1739 microversion: 2.20 time: 0.206365 Sep 13 07:03:35.832961 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 182/336] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:35 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:03:35.920105 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bbbb8c38-2c61-4f55-b725-677f923ea8cd tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:35.920938 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bbbb8c38-2c61-4f55-b725-677f923ea8cd tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:35.931564 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bbbb8c38-2c61-4f55-b725-677f923ea8cd tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:35.931949 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bbbb8c38-2c61-4f55-b725-677f923ea8cd tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:35.932845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bbbb8c38-2c61-4f55-b725-677f923ea8cd tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:35.933829 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bbbb8c38-2c61-4f55-b725-677f923ea8cd tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:35.936397 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bbbb8c38-2c61-4f55-b725-677f923ea8cd tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:35.936824 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bbbb8c38-2c61-4f55-b725-677f923ea8cd tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:36.130789 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bbbb8c38-2c61-4f55-b725-677f923ea8cd tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:36.145048 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bbbb8c38-2c61-4f55-b725-677f923ea8cd tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1357 microversion: 2.1 time: 0.228850 Sep 13 07:03:36.145717 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 155/337] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:35 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1357 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:36.276501 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b6fa8326-dd00-4926-ac7e-1afe143afb70 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:36.277844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b6fa8326-dd00-4926-ac7e-1afe143afb70 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:36.285006 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b6fa8326-dd00-4926-ac7e-1afe143afb70 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:36.285658 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b6fa8326-dd00-4926-ac7e-1afe143afb70 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:36.286292 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b6fa8326-dd00-4926-ac7e-1afe143afb70 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:36.287175 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b6fa8326-dd00-4926-ac7e-1afe143afb70 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:36.287782 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b6fa8326-dd00-4926-ac7e-1afe143afb70 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:36.288403 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b6fa8326-dd00-4926-ac7e-1afe143afb70 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:36.438917 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-efd88c99-ba3f-40d2-a352-80cbb6f4e661 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:36.439630 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-efd88c99-ba3f-40d2-a352-80cbb6f4e661 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:36.441010 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b6fa8326-dd00-4926-ac7e-1afe143afb70 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:36.445670 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-efd88c99-ba3f-40d2-a352-80cbb6f4e661 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:36.446212 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-efd88c99-ba3f-40d2-a352-80cbb6f4e661 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:36.446650 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-efd88c99-ba3f-40d2-a352-80cbb6f4e661 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:36.447349 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-efd88c99-ba3f-40d2-a352-80cbb6f4e661 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:36.448065 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-efd88c99-ba3f-40d2-a352-80cbb6f4e661 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:36.448797 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-efd88c99-ba3f-40d2-a352-80cbb6f4e661 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:36.452577 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b6fa8326-dd00-4926-ac7e-1afe143afb70 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1364 microversion: 2.1 time: 0.179800 Sep 13 07:03:36.453376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 183/338] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:36 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:36.514043 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-efd88c99-ba3f-40d2-a352-80cbb6f4e661 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:36.521913 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-efd88c99-ba3f-40d2-a352-80cbb6f4e661 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1249 microversion: 2.1 time: 0.087064 Sep 13 07:03:36.522603 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 156/339] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:36 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:36.858510 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-420152e6-188b-40ae-956d-ceac7bf8c050 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:36.859558 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-420152e6-188b-40ae-956d-ceac7bf8c050 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:36.866718 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-420152e6-188b-40ae-956d-ceac7bf8c050 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:36.867515 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-420152e6-188b-40ae-956d-ceac7bf8c050 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:36.868042 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-420152e6-188b-40ae-956d-ceac7bf8c050 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:36.869151 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-420152e6-188b-40ae-956d-ceac7bf8c050 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:36.869885 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-420152e6-188b-40ae-956d-ceac7bf8c050 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:36.870412 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-420152e6-188b-40ae-956d-ceac7bf8c050 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:37.068232 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-420152e6-188b-40ae-956d-ceac7bf8c050 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:37.082445 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-420152e6-188b-40ae-956d-ceac7bf8c050 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:37.084445 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-420152e6-188b-40ae-956d-ceac7bf8c050 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:37.088228 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-420152e6-188b-40ae-956d-ceac7bf8c050 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1739 microversion: 2.20 time: 0.232851 Sep 13 07:03:37.105979 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 184/340] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:36 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:03:37.173527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4b88c46a-7dd6-46c7-9545-8125d5b9a139 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:37.174195 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4b88c46a-7dd6-46c7-9545-8125d5b9a139 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:37.181358 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4b88c46a-7dd6-46c7-9545-8125d5b9a139 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:37.182184 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4b88c46a-7dd6-46c7-9545-8125d5b9a139 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:37.182875 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4b88c46a-7dd6-46c7-9545-8125d5b9a139 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:37.183576 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4b88c46a-7dd6-46c7-9545-8125d5b9a139 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:37.184026 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4b88c46a-7dd6-46c7-9545-8125d5b9a139 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:37.184444 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4b88c46a-7dd6-46c7-9545-8125d5b9a139 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:37.334840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4b88c46a-7dd6-46c7-9545-8125d5b9a139 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:37.344244 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4b88c46a-7dd6-46c7-9545-8125d5b9a139 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1357 microversion: 2.1 time: 0.174944 Sep 13 07:03:37.345138 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 157/341] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:37 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:37.451693 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6e64d677-a979-47bf-85ff-0a5d8c46d144 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-393103098", "imageRef": "19a6700e-e153-4bea-87aa-036bfccf0ecd", "flavorRef": "452"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:03:37.477321 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3206a410-fee5-4a83-86c0-036b1ec814b2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:37.478109 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3206a410-fee5-4a83-86c0-036b1ec814b2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:37.486833 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3206a410-fee5-4a83-86c0-036b1ec814b2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:37.495267 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3206a410-fee5-4a83-86c0-036b1ec814b2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:37.496067 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3206a410-fee5-4a83-86c0-036b1ec814b2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:37.496964 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3206a410-fee5-4a83-86c0-036b1ec814b2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:37.497596 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3206a410-fee5-4a83-86c0-036b1ec814b2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:37.498441 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3206a410-fee5-4a83-86c0-036b1ec814b2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:37.535912 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-6e64d677-a979-47bf-85ff-0a5d8c46d144 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] validate_networks() for None {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:03:37.876319 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3206a410-fee5-4a83-86c0-036b1ec814b2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:37.942531 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3206a410-fee5-4a83-86c0-036b1ec814b2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1364 microversion: 2.1 time: 0.467511 Sep 13 07:03:37.960840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 158/342] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:37 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1364 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:37.968457 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b7a82cdf-04ff-478f-8e1f-9bfc0f375da5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:37.969421 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b7a82cdf-04ff-478f-8e1f-9bfc0f375da5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:37.976398 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b7a82cdf-04ff-478f-8e1f-9bfc0f375da5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:37.977390 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b7a82cdf-04ff-478f-8e1f-9bfc0f375da5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:37.978455 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b7a82cdf-04ff-478f-8e1f-9bfc0f375da5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:37.979870 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b7a82cdf-04ff-478f-8e1f-9bfc0f375da5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:37.981941 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b7a82cdf-04ff-478f-8e1f-9bfc0f375da5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:37.983436 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b7a82cdf-04ff-478f-8e1f-9bfc0f375da5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:38.022411 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-6e64d677-a979-47bf-85ff-0a5d8c46d144 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:03:38.022832 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-6e64d677-a979-47bf-85ff-0a5d8c46d144 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:03:38.023296 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-6e64d677-a979-47bf-85ff-0a5d8c46d144 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:03:38.023698 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-6e64d677-a979-47bf-85ff-0a5d8c46d144 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:03:38.024152 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-6e64d677-a979-47bf-85ff-0a5d8c46d144 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:03:38.036874 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e64d677-a979-47bf-85ff-0a5d8c46d144 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:38.037832 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e64d677-a979-47bf-85ff-0a5d8c46d144 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:38.038485 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e64d677-a979-47bf-85ff-0a5d8c46d144 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:38.050548 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e64d677-a979-47bf-85ff-0a5d8c46d144 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:38.051114 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e64d677-a979-47bf-85ff-0a5d8c46d144 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:38.051550 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e64d677-a979-47bf-85ff-0a5d8c46d144 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:38.101849 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-6e64d677-a979-47bf-85ff-0a5d8c46d144 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Getting quotas for project 5006f7a1770f4d9a96cbec0715987237. Resources: {'instances', 'cores', 'ram'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:03:38.113007 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-6e64d677-a979-47bf-85ff-0a5d8c46d144 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Getting quotas for user 7e0774e048684f6b8f79ee44f1c4ff7c and project 5006f7a1770f4d9a96cbec0715987237. Resources: {'instances', 'cores', 'ram'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:03:38.132578 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6e64d677-a979-47bf-85ff-0a5d8c46d144 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:03:38.136344 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6e64d677-a979-47bf-85ff-0a5d8c46d144 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='19a6700e-e153-4bea-87aa-036bfccf0ecd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:03:38.181740 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b7a82cdf-04ff-478f-8e1f-9bfc0f375da5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:38.199081 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b7a82cdf-04ff-478f-8e1f-9bfc0f375da5 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1297 microversion: 2.1 time: 0.236517 Sep 13 07:03:38.199993 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 159/343] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:37 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1297 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:38.210509 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-cb858e34-8a73-4106-b33e-ede6f153c646 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:38.211362 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-cb858e34-8a73-4106-b33e-ede6f153c646 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:38.220770 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cb858e34-8a73-4106-b33e-ede6f153c646 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:38.226309 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cb858e34-8a73-4106-b33e-ede6f153c646 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:38.226309 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cb858e34-8a73-4106-b33e-ede6f153c646 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:38.226309 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cb858e34-8a73-4106-b33e-ede6f153c646 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:38.226309 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cb858e34-8a73-4106-b33e-ede6f153c646 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:38.226923 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cb858e34-8a73-4106-b33e-ede6f153c646 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:38.257641 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6e64d677-a979-47bf-85ff-0a5d8c46d144 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810302 Sep 13 07:03:38.258862 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 185/344] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Sep 13 07:03:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 07:03:38.273288 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d888ce8d-8fd0-40bf-bf40-7488ae645ba4 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:38.274229 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d888ce8d-8fd0-40bf-bf40-7488ae645ba4 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:38.377437 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d888ce8d-8fd0-40bf-bf40-7488ae645ba4 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:38.391460 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d888ce8d-8fd0-40bf-bf40-7488ae645ba4 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1214 microversion: 2.1 time: 0.122913 Sep 13 07:03:38.392735 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 186/345] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:38 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1214 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:03:38.411157 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d0239093-e3e1-4ec9-b6e4-97feb954c6d0 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:38.412453 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d0239093-e3e1-4ec9-b6e4-97feb954c6d0 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:38.441174 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d0239093-e3e1-4ec9-b6e4-97feb954c6d0 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:38.453883 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d0239093-e3e1-4ec9-b6e4-97feb954c6d0 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:38.454636 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d0239093-e3e1-4ec9-b6e4-97feb954c6d0 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:38.455251 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d0239093-e3e1-4ec9-b6e4-97feb954c6d0 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:38.455756 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d0239093-e3e1-4ec9-b6e4-97feb954c6d0 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:38.456198 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d0239093-e3e1-4ec9-b6e4-97feb954c6d0 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:38.551723 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-cb858e34-8a73-4106-b33e-ede6f153c646 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:38.570332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-cb858e34-8a73-4106-b33e-ede6f153c646 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:38.580011 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-cb858e34-8a73-4106-b33e-ede6f153c646 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:38.587298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-cb858e34-8a73-4106-b33e-ede6f153c646 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1739 microversion: 2.20 time: 0.384988 Sep 13 07:03:38.591164 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 160/346] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:38 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1739 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:03:38.743775 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d0239093-e3e1-4ec9-b6e4-97feb954c6d0 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:38.759581 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d0239093-e3e1-4ec9-b6e4-97feb954c6d0 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1357 microversion: 2.1 time: 0.365432 Sep 13 07:03:38.763819 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 187/347] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:38 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1357 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:38.968967 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-49f97815-7b14-4127-9945-78b27fac2195 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:38.969904 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-49f97815-7b14-4127-9945-78b27fac2195 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:38.976724 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-49f97815-7b14-4127-9945-78b27fac2195 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:38.977303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-49f97815-7b14-4127-9945-78b27fac2195 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:38.977761 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-49f97815-7b14-4127-9945-78b27fac2195 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:38.978617 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-49f97815-7b14-4127-9945-78b27fac2195 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:38.979408 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-49f97815-7b14-4127-9945-78b27fac2195 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:38.979861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-49f97815-7b14-4127-9945-78b27fac2195 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:39.167906 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-49f97815-7b14-4127-9945-78b27fac2195 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:39.176743 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-49f97815-7b14-4127-9945-78b27fac2195 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1364 microversion: 2.1 time: 0.212447 Sep 13 07:03:39.178860 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 161/348] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:38 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:03:39.230451 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f7882960-00a9-4699-aa24-b0b103021181 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:39.231254 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f7882960-00a9-4699-aa24-b0b103021181 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:39.238277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f7882960-00a9-4699-aa24-b0b103021181 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:39.239013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f7882960-00a9-4699-aa24-b0b103021181 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:39.239688 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f7882960-00a9-4699-aa24-b0b103021181 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:39.240434 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f7882960-00a9-4699-aa24-b0b103021181 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:39.241036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f7882960-00a9-4699-aa24-b0b103021181 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:39.241675 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f7882960-00a9-4699-aa24-b0b103021181 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:39.311687 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f7882960-00a9-4699-aa24-b0b103021181 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:39.321872 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f7882960-00a9-4699-aa24-b0b103021181 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1297 microversion: 2.1 time: 0.096037 Sep 13 07:03:39.322615 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 188/349] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:39 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:39.419989 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e3446aa5-980a-4508-b8a4-78048bea51bb tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:39.420510 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e3446aa5-980a-4508-b8a4-78048bea51bb tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:39.426732 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3446aa5-980a-4508-b8a4-78048bea51bb tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:39.427375 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3446aa5-980a-4508-b8a4-78048bea51bb tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:39.427962 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3446aa5-980a-4508-b8a4-78048bea51bb tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:39.428663 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3446aa5-980a-4508-b8a4-78048bea51bb tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:39.429138 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3446aa5-980a-4508-b8a4-78048bea51bb tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:39.429580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3446aa5-980a-4508-b8a4-78048bea51bb tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:39.506186 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e3446aa5-980a-4508-b8a4-78048bea51bb tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:39.516178 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e3446aa5-980a-4508-b8a4-78048bea51bb tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1210 microversion: 2.1 time: 0.102665 Sep 13 07:03:39.517214 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 162/350] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:39 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:39.622445 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-96af501e-ef99-4061-b853-a6880694811a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:39.623787 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-96af501e-ef99-4061-b853-a6880694811a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:39.630855 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96af501e-ef99-4061-b853-a6880694811a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:39.632258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96af501e-ef99-4061-b853-a6880694811a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:39.632927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96af501e-ef99-4061-b853-a6880694811a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:39.633952 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96af501e-ef99-4061-b853-a6880694811a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:39.634860 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96af501e-ef99-4061-b853-a6880694811a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:39.635800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96af501e-ef99-4061-b853-a6880694811a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:39.787092 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-acd9ddde-8328-495d-aca8-91f8b64cb934 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:39.787728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-acd9ddde-8328-495d-aca8-91f8b64cb934 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:39.800756 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-acd9ddde-8328-495d-aca8-91f8b64cb934 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:39.803374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-acd9ddde-8328-495d-aca8-91f8b64cb934 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:39.804181 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-acd9ddde-8328-495d-aca8-91f8b64cb934 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:39.807225 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-acd9ddde-8328-495d-aca8-91f8b64cb934 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:39.809039 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-acd9ddde-8328-495d-aca8-91f8b64cb934 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:39.809195 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-acd9ddde-8328-495d-aca8-91f8b64cb934 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:39.864830 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-96af501e-ef99-4061-b853-a6880694811a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:39.874941 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-96af501e-ef99-4061-b853-a6880694811a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:39.877618 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=100 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:39.879571 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-96af501e-ef99-4061-b853-a6880694811a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:39.881136 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-96af501e-ef99-4061-b853-a6880694811a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1739 microversion: 2.20 time: 0.264005 Sep 13 07:03:39.882336 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 189/351] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:39 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:03:40.038732 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-acd9ddde-8328-495d-aca8-91f8b64cb934 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:40.055189 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-acd9ddde-8328-495d-aca8-91f8b64cb934 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1357 microversion: 2.1 time: 0.272110 Sep 13 07:03:40.056741 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 163/352] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:39 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1357 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:40.202383 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-63139071-7a61-4d75-a109-6e715966c348 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:40.203290 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-63139071-7a61-4d75-a109-6e715966c348 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:40.210417 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-63139071-7a61-4d75-a109-6e715966c348 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:40.210744 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-63139071-7a61-4d75-a109-6e715966c348 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:40.211188 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-63139071-7a61-4d75-a109-6e715966c348 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:40.211878 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-63139071-7a61-4d75-a109-6e715966c348 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:40.212378 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-63139071-7a61-4d75-a109-6e715966c348 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:40.212803 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-63139071-7a61-4d75-a109-6e715966c348 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:40.345034 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a4b13612-fd2d-4836-9f7b-1ee95cf5173d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:40.346310 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a4b13612-fd2d-4836-9f7b-1ee95cf5173d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:40.364509 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a4b13612-fd2d-4836-9f7b-1ee95cf5173d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:40.366683 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a4b13612-fd2d-4836-9f7b-1ee95cf5173d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:40.368323 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a4b13612-fd2d-4836-9f7b-1ee95cf5173d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:40.369781 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a4b13612-fd2d-4836-9f7b-1ee95cf5173d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:40.370587 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a4b13612-fd2d-4836-9f7b-1ee95cf5173d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:40.371265 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a4b13612-fd2d-4836-9f7b-1ee95cf5173d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:40.574420 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a4b13612-fd2d-4836-9f7b-1ee95cf5173d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:40.603403 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a4b13612-fd2d-4836-9f7b-1ee95cf5173d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1305 microversion: 2.1 time: 0.251219 Sep 13 07:03:40.616696 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 164/353] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:40 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1305 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:40.630123 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-546a16e3-0b28-4d46-a43f-56abb6162696 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:40.631836 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-546a16e3-0b28-4d46-a43f-56abb6162696 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:40.647687 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-546a16e3-0b28-4d46-a43f-56abb6162696 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:40.648171 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-546a16e3-0b28-4d46-a43f-56abb6162696 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:40.648597 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-546a16e3-0b28-4d46-a43f-56abb6162696 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:40.655083 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-546a16e3-0b28-4d46-a43f-56abb6162696 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:40.655581 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-546a16e3-0b28-4d46-a43f-56abb6162696 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:40.656012 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-546a16e3-0b28-4d46-a43f-56abb6162696 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:40.750516 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-63139071-7a61-4d75-a109-6e715966c348 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:40.771044 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-63139071-7a61-4d75-a109-6e715966c348 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1553 microversion: 2.1 time: 0.572689 Sep 13 07:03:40.774520 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 190/354] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:40 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1553 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:40.808930 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1b37258b-704f-44fb-8ebc-2846bab921b3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:40.812375 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1b37258b-704f-44fb-8ebc-2846bab921b3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:40.827412 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1b37258b-704f-44fb-8ebc-2846bab921b3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:40.827945 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1b37258b-704f-44fb-8ebc-2846bab921b3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:40.829039 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1b37258b-704f-44fb-8ebc-2846bab921b3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:40.829934 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1b37258b-704f-44fb-8ebc-2846bab921b3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:40.830561 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1b37258b-704f-44fb-8ebc-2846bab921b3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:40.831140 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1b37258b-704f-44fb-8ebc-2846bab921b3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:40.864974 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-546a16e3-0b28-4d46-a43f-56abb6162696 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:40.878717 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-546a16e3-0b28-4d46-a43f-56abb6162696 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1266 microversion: 2.1 time: 0.258866 Sep 13 07:03:40.880188 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 165/355] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:40 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:40.907113 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-728108cc-2f83-4b41-b749-3b88cc58dba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:40.907891 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-728108cc-2f83-4b41-b749-3b88cc58dba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:40.918886 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-728108cc-2f83-4b41-b749-3b88cc58dba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:40.921121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-728108cc-2f83-4b41-b749-3b88cc58dba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:40.921727 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-728108cc-2f83-4b41-b749-3b88cc58dba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:40.922678 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-728108cc-2f83-4b41-b749-3b88cc58dba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:40.923287 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-728108cc-2f83-4b41-b749-3b88cc58dba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:40.923900 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-728108cc-2f83-4b41-b749-3b88cc58dba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:41.321044 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1b37258b-704f-44fb-8ebc-2846bab921b3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.517873 Sep 13 07:03:41.322028 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 191/356] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Sep 13 07:03:40 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439/os-interface => generated 284 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:03:41.335788 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b0789b82-3f7c-44d6-ae99-c74194c3d10d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:41.337043 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b0789b82-3f7c-44d6-ae99-c74194c3d10d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:41.344348 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0789b82-3f7c-44d6-ae99-c74194c3d10d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:41.345177 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0789b82-3f7c-44d6-ae99-c74194c3d10d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:41.345824 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0789b82-3f7c-44d6-ae99-c74194c3d10d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:41.347044 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0789b82-3f7c-44d6-ae99-c74194c3d10d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:41.347717 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0789b82-3f7c-44d6-ae99-c74194c3d10d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:41.348318 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0789b82-3f7c-44d6-ae99-c74194c3d10d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:41.378641 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:41.773838 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-728108cc-2f83-4b41-b749-3b88cc58dba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:41.785101 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-728108cc-2f83-4b41-b749-3b88cc58dba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:41.793046 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-728108cc-2f83-4b41-b749-3b88cc58dba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:41.796140 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-728108cc-2f83-4b41-b749-3b88cc58dba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1739 microversion: 2.20 time: 0.892950 Sep 13 07:03:41.797308 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 166/357] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:40 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1739 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:03:41.803846 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-af236c4f-334d-4407-a3ef-e6a9d205651f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:41.804764 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-af236c4f-334d-4407-a3ef-e6a9d205651f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:41.813682 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af236c4f-334d-4407-a3ef-e6a9d205651f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:41.814586 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af236c4f-334d-4407-a3ef-e6a9d205651f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:41.816333 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af236c4f-334d-4407-a3ef-e6a9d205651f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:41.817209 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af236c4f-334d-4407-a3ef-e6a9d205651f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:41.817852 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af236c4f-334d-4407-a3ef-e6a9d205651f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:41.818520 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af236c4f-334d-4407-a3ef-e6a9d205651f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:41.892310 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=24 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:42.019727 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-af236c4f-334d-4407-a3ef-e6a9d205651f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:42.032321 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-af236c4f-334d-4407-a3ef-e6a9d205651f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1303 microversion: 2.1 time: 0.233329 Sep 13 07:03:42.044768 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 167/358] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:41 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1303 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:42.049828 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-75b9181f-6af4-48ab-971c-5e35dc208dba tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:42.050649 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-75b9181f-6af4-48ab-971c-5e35dc208dba tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:42.057080 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75b9181f-6af4-48ab-971c-5e35dc208dba tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:42.057808 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75b9181f-6af4-48ab-971c-5e35dc208dba tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:42.065938 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75b9181f-6af4-48ab-971c-5e35dc208dba tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:42.066891 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75b9181f-6af4-48ab-971c-5e35dc208dba tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:42.067369 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75b9181f-6af4-48ab-971c-5e35dc208dba tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:42.067801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75b9181f-6af4-48ab-971c-5e35dc208dba tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:42.140900 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b0789b82-3f7c-44d6-ae99-c74194c3d10d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:42.149506 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b0789b82-3f7c-44d6-ae99-c74194c3d10d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1357 microversion: 2.1 time: 0.825908 Sep 13 07:03:42.152274 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 192/359] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:41 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1357 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:42.226985 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-75b9181f-6af4-48ab-971c-5e35dc208dba tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:42.242684 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-75b9181f-6af4-48ab-971c-5e35dc208dba tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1272 microversion: 2.1 time: 0.196563 Sep 13 07:03:42.243831 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 168/360] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:42 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1272 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:42.418945 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-fa4f58f6-6021-4527-a95b-2b137596ad33 req-7a681fae-b64e-4a18-b9a4-9f636ed17abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64680760-9370-4f3b-acc5-0ed7d1796015", "name": "network-vif-plugged", "status": "completed", "tag": "1e7460cd-303f-44c8-b234-3c2f83c1e238"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:03:42.439021 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-fa4f58f6-6021-4527-a95b-2b137596ad33 req-7a681fae-b64e-4a18-b9a4-9f636ed17abe service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:42.439504 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-fa4f58f6-6021-4527-a95b-2b137596ad33 req-7a681fae-b64e-4a18-b9a4-9f636ed17abe service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:42.441980 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-fa4f58f6-6021-4527-a95b-2b137596ad33 req-7a681fae-b64e-4a18-b9a4-9f636ed17abe service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:42.472775 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-fa4f58f6-6021-4527-a95b-2b137596ad33 req-7a681fae-b64e-4a18-b9a4-9f636ed17abe service nova] Creating event network-vif-plugged:1e7460cd-303f-44c8-b234-3c2f83c1e238 for instance 64680760-9370-4f3b-acc5-0ed7d1796015 on hv-cinder-85694 Sep 13 07:03:42.483092 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-fa4f58f6-6021-4527-a95b-2b137596ad33 req-7a681fae-b64e-4a18-b9a4-9f636ed17abe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071594 Sep 13 07:03:42.484099 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 193/361] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:03:42.828158 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f152afec-8a96-4e81-8e77-7236c868d128 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:42.829325 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f152afec-8a96-4e81-8e77-7236c868d128 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:42.840615 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f152afec-8a96-4e81-8e77-7236c868d128 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:42.842999 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f152afec-8a96-4e81-8e77-7236c868d128 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:42.843745 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f152afec-8a96-4e81-8e77-7236c868d128 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:42.844679 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f152afec-8a96-4e81-8e77-7236c868d128 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:42.847152 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f152afec-8a96-4e81-8e77-7236c868d128 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:42.848752 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f152afec-8a96-4e81-8e77-7236c868d128 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:43.061243 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-26d10b61-1142-46ea-9328-4360b1e54627 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:43.068460 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-26d10b61-1142-46ea-9328-4360b1e54627 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:43.087921 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-26d10b61-1142-46ea-9328-4360b1e54627 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:43.088831 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-26d10b61-1142-46ea-9328-4360b1e54627 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:43.090596 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-26d10b61-1142-46ea-9328-4360b1e54627 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:43.091647 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-26d10b61-1142-46ea-9328-4360b1e54627 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:43.092337 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-26d10b61-1142-46ea-9328-4360b1e54627 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:43.092996 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-26d10b61-1142-46ea-9328-4360b1e54627 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:43.282430 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-26d10b61-1142-46ea-9328-4360b1e54627 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:43.293655 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-26d10b61-1142-46ea-9328-4360b1e54627 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1303 microversion: 2.1 time: 0.235919 Sep 13 07:03:43.294668 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 194/362] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:43 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1303 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:43.305112 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-34d926f0-a0e2-48f9-88be-e23c4029570f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:43.306473 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-34d926f0-a0e2-48f9-88be-e23c4029570f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:43.323333 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34d926f0-a0e2-48f9-88be-e23c4029570f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:43.324673 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34d926f0-a0e2-48f9-88be-e23c4029570f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:43.325322 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34d926f0-a0e2-48f9-88be-e23c4029570f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:43.326297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34d926f0-a0e2-48f9-88be-e23c4029570f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:43.327398 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34d926f0-a0e2-48f9-88be-e23c4029570f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:43.328078 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34d926f0-a0e2-48f9-88be-e23c4029570f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:43.536694 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f152afec-8a96-4e81-8e77-7236c868d128 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:43.548625 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f152afec-8a96-4e81-8e77-7236c868d128 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:43.550109 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f152afec-8a96-4e81-8e77-7236c868d128 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:43.551293 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f152afec-8a96-4e81-8e77-7236c868d128 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1739 microversion: 2.20 time: 0.728150 Sep 13 07:03:43.567728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 169/363] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:42 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1739 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:03:43.581414 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4ef2b2ea-82f5-4182-95ba-e4e9ba67c03f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:43.584958 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4ef2b2ea-82f5-4182-95ba-e4e9ba67c03f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:43.595316 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ef2b2ea-82f5-4182-95ba-e4e9ba67c03f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:43.597512 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ef2b2ea-82f5-4182-95ba-e4e9ba67c03f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:43.598939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ef2b2ea-82f5-4182-95ba-e4e9ba67c03f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:43.601287 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ef2b2ea-82f5-4182-95ba-e4e9ba67c03f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:43.605722 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ef2b2ea-82f5-4182-95ba-e4e9ba67c03f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:43.606818 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ef2b2ea-82f5-4182-95ba-e4e9ba67c03f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:43.838105 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4ef2b2ea-82f5-4182-95ba-e4e9ba67c03f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:43.854963 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4ef2b2ea-82f5-4182-95ba-e4e9ba67c03f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1272 microversion: 2.1 time: 0.277959 Sep 13 07:03:43.870961 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 170/364] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:43 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1272 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:44.332087 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0ba457eb-40a6-4411-b2dc-88d0bd17a528 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:44.334360 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0ba457eb-40a6-4411-b2dc-88d0bd17a528 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:44.356193 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0ba457eb-40a6-4411-b2dc-88d0bd17a528 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:44.360992 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0ba457eb-40a6-4411-b2dc-88d0bd17a528 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:44.361886 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0ba457eb-40a6-4411-b2dc-88d0bd17a528 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:44.366620 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0ba457eb-40a6-4411-b2dc-88d0bd17a528 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:44.367418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0ba457eb-40a6-4411-b2dc-88d0bd17a528 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:44.369763 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0ba457eb-40a6-4411-b2dc-88d0bd17a528 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:44.527245 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-34d926f0-a0e2-48f9-88be-e23c4029570f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:44.565273 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-34d926f0-a0e2-48f9-88be-e23c4029570f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1357 microversion: 2.1 time: 1.269277 Sep 13 07:03:44.568108 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 195/365] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:43 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1357 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:44.594707 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1789d872-3f4b-4df0-acc4-fff5d3169e15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:44.605859 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1789d872-3f4b-4df0-acc4-fff5d3169e15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:44.627840 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1789d872-3f4b-4df0-acc4-fff5d3169e15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:44.633325 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1789d872-3f4b-4df0-acc4-fff5d3169e15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:44.635700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1789d872-3f4b-4df0-acc4-fff5d3169e15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:44.637062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1789d872-3f4b-4df0-acc4-fff5d3169e15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:44.639988 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1789d872-3f4b-4df0-acc4-fff5d3169e15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:44.643065 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1789d872-3f4b-4df0-acc4-fff5d3169e15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:45.076087 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0ba457eb-40a6-4411-b2dc-88d0bd17a528 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:45.086829 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0ba457eb-40a6-4411-b2dc-88d0bd17a528 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1371 microversion: 2.1 time: 0.766886 Sep 13 07:03:45.088016 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 171/366] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:44 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1371 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:45.094632 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-677dc070-aa5d-4e63-b3e1-315e1fccc633 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:45.096411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-677dc070-aa5d-4e63-b3e1-315e1fccc633 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:45.108168 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-677dc070-aa5d-4e63-b3e1-315e1fccc633 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:45.108835 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-677dc070-aa5d-4e63-b3e1-315e1fccc633 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:45.109434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-677dc070-aa5d-4e63-b3e1-315e1fccc633 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:45.110378 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-677dc070-aa5d-4e63-b3e1-315e1fccc633 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:45.110980 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-677dc070-aa5d-4e63-b3e1-315e1fccc633 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:45.111960 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-677dc070-aa5d-4e63-b3e1-315e1fccc633 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:45.331006 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-677dc070-aa5d-4e63-b3e1-315e1fccc633 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:45.347474 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-677dc070-aa5d-4e63-b3e1-315e1fccc633 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1272 microversion: 2.1 time: 0.256946 Sep 13 07:03:45.348601 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 172/367] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:45 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1272 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:45.451730 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1789d872-3f4b-4df0-acc4-fff5d3169e15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:45.472892 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1789d872-3f4b-4df0-acc4-fff5d3169e15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:45.474979 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1789d872-3f4b-4df0-acc4-fff5d3169e15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:45.477814 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1789d872-3f4b-4df0-acc4-fff5d3169e15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1739 microversion: 2.20 time: 0.888520 Sep 13 07:03:45.479610 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 196/368] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:44 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1739 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:03:45.600659 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-90acdf8a-22f2-4047-b5a9-b02a4eddd205 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:45.601275 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-90acdf8a-22f2-4047-b5a9-b02a4eddd205 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:45.615598 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-90acdf8a-22f2-4047-b5a9-b02a4eddd205 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:45.618131 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-90acdf8a-22f2-4047-b5a9-b02a4eddd205 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:45.618580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-90acdf8a-22f2-4047-b5a9-b02a4eddd205 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:45.619309 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-90acdf8a-22f2-4047-b5a9-b02a4eddd205 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:45.619882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-90acdf8a-22f2-4047-b5a9-b02a4eddd205 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:45.620279 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-90acdf8a-22f2-4047-b5a9-b02a4eddd205 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:46.115218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-eb0bd6fb-5f8a-42e5-b792-b5c534f5b945 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:46.116029 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-eb0bd6fb-5f8a-42e5-b792-b5c534f5b945 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:46.128687 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb0bd6fb-5f8a-42e5-b792-b5c534f5b945 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:46.129328 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb0bd6fb-5f8a-42e5-b792-b5c534f5b945 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:46.130025 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb0bd6fb-5f8a-42e5-b792-b5c534f5b945 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:46.131001 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb0bd6fb-5f8a-42e5-b792-b5c534f5b945 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:46.131705 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb0bd6fb-5f8a-42e5-b792-b5c534f5b945 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:46.132361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb0bd6fb-5f8a-42e5-b792-b5c534f5b945 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:46.144231 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:46.323145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-90acdf8a-22f2-4047-b5a9-b02a4eddd205 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:46.331565 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-90acdf8a-22f2-4047-b5a9-b02a4eddd205 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1546 microversion: 2.1 time: 0.740603 Sep 13 07:03:46.336071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 173/369] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:45 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1546 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:46.362257 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2b2b11cd-3439-4052-903d-cf2443fa96f6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:46.363265 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2b2b11cd-3439-4052-903d-cf2443fa96f6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:46.375818 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b2b11cd-3439-4052-903d-cf2443fa96f6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:46.376357 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b2b11cd-3439-4052-903d-cf2443fa96f6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:46.376785 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b2b11cd-3439-4052-903d-cf2443fa96f6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:46.377680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b2b11cd-3439-4052-903d-cf2443fa96f6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:46.378540 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b2b11cd-3439-4052-903d-cf2443fa96f6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:46.379147 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b2b11cd-3439-4052-903d-cf2443fa96f6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:46.835511 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2b2b11cd-3439-4052-903d-cf2443fa96f6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:46.865622 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2b2b11cd-3439-4052-903d-cf2443fa96f6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1546 microversion: 2.1 time: 0.507332 Sep 13 07:03:46.866759 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 174/370] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:46 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1546 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:03:46.884407 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f252ca30-e6f8-4dca-bac6-0926033cbcdc tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:46.885378 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f252ca30-e6f8-4dca-bac6-0926033cbcdc tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:46.897340 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f252ca30-e6f8-4dca-bac6-0926033cbcdc tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:46.898216 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f252ca30-e6f8-4dca-bac6-0926033cbcdc tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:46.899081 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f252ca30-e6f8-4dca-bac6-0926033cbcdc tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:46.899956 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f252ca30-e6f8-4dca-bac6-0926033cbcdc tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:46.903024 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f252ca30-e6f8-4dca-bac6-0926033cbcdc tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:46.903965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f252ca30-e6f8-4dca-bac6-0926033cbcdc tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:46.988331 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-eb0bd6fb-5f8a-42e5-b792-b5c534f5b945 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:46.997875 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-eb0bd6fb-5f8a-42e5-b792-b5c534f5b945 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1371 microversion: 2.1 time: 0.886478 Sep 13 07:03:46.999431 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 197/371] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:46 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1371 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:03:47.019685 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-e948b9c2-0c3d-48bf-b30a-69731a268455 req-7acd9a67-6945-4916-8d56-5c71860b34c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e9c0b75-cd49-4a40-bd4c-24ab750fd439", "tag": "db48239f-b745-42d1-9812-35356ecdcc86"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:03:47.053194 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e948b9c2-0c3d-48bf-b30a-69731a268455 req-7acd9a67-6945-4916-8d56-5c71860b34c9 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:47.054225 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e948b9c2-0c3d-48bf-b30a-69731a268455 req-7acd9a67-6945-4916-8d56-5c71860b34c9 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:47.054809 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e948b9c2-0c3d-48bf-b30a-69731a268455 req-7acd9a67-6945-4916-8d56-5c71860b34c9 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:47.080856 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-e948b9c2-0c3d-48bf-b30a-69731a268455 req-7acd9a67-6945-4916-8d56-5c71860b34c9 service nova] Creating event network-changed:db48239f-b745-42d1-9812-35356ecdcc86 for instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 on hv-cinder-85694 Sep 13 07:03:47.096934 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-e948b9c2-0c3d-48bf-b30a-69731a268455 req-7acd9a67-6945-4916-8d56-5c71860b34c9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080817 Sep 13 07:03:47.098232 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 198/372] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:03:47.104471 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-65e210e4-bd0e-46c1-88d5-97249e9cc6e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:47.112453 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-65e210e4-bd0e-46c1-88d5-97249e9cc6e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:47.128211 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65e210e4-bd0e-46c1-88d5-97249e9cc6e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:47.129643 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65e210e4-bd0e-46c1-88d5-97249e9cc6e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:47.130099 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65e210e4-bd0e-46c1-88d5-97249e9cc6e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:47.135972 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65e210e4-bd0e-46c1-88d5-97249e9cc6e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:47.135972 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65e210e4-bd0e-46c1-88d5-97249e9cc6e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:47.135972 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65e210e4-bd0e-46c1-88d5-97249e9cc6e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:47.732812 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f252ca30-e6f8-4dca-bac6-0926033cbcdc tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:47.746691 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f252ca30-e6f8-4dca-bac6-0926033cbcdc tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1314 microversion: 2.1 time: 0.878525 Sep 13 07:03:47.754405 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 175/373] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:46 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1314 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:47.765308 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8fc26afd-a62a-4544-a627-a2107db8f0e1 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:47.779100 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8fc26afd-a62a-4544-a627-a2107db8f0e1 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:47.780167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8fc26afd-a62a-4544-a627-a2107db8f0e1 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Searching by: {'deleted': False, 'project_id': '76569a470885443abfbe4e14e9b2f505'} {{(pid=120695) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 07:03:47.794043 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8fc26afd-a62a-4544-a627-a2107db8f0e1 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:47.796651 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8fc26afd-a62a-4544-a627-a2107db8f0e1 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:47.798982 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8fc26afd-a62a-4544-a627-a2107db8f0e1 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:47.800264 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8fc26afd-a62a-4544-a627-a2107db8f0e1 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:47.800896 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8fc26afd-a62a-4544-a627-a2107db8f0e1 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:47.802609 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8fc26afd-a62a-4544-a627-a2107db8f0e1 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:47.959367 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-65e210e4-bd0e-46c1-88d5-97249e9cc6e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:47.977041 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-65e210e4-bd0e-46c1-88d5-97249e9cc6e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:47.983918 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-65e210e4-bd0e-46c1-88d5-97249e9cc6e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:47.985170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-65e210e4-bd0e-46c1-88d5-97249e9cc6e4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1739 microversion: 2.20 time: 0.885558 Sep 13 07:03:47.985734 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 199/374] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:47 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1739 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:03:48.022294 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-de04bb89-bf67-4715-9476-46e90c5083ec tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:48.023529 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-de04bb89-bf67-4715-9476-46e90c5083ec tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:48.035138 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-de04bb89-bf67-4715-9476-46e90c5083ec tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:48.039903 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-de04bb89-bf67-4715-9476-46e90c5083ec tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:48.040632 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-de04bb89-bf67-4715-9476-46e90c5083ec tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:48.042470 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-de04bb89-bf67-4715-9476-46e90c5083ec tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:48.047302 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-de04bb89-bf67-4715-9476-46e90c5083ec tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:48.048152 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-de04bb89-bf67-4715-9476-46e90c5083ec tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:48.053296 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.multi_cell_list [None req-8fc26afd-a62a-4544-a627-a2107db8f0e1 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120695) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 07:03:48.104376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:48.335694 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8fc26afd-a62a-4544-a627-a2107db8f0e1 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.579779 Sep 13 07:03:48.337276 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 176/375] 10.222.0.25 () {58 vars in 1125 bytes} [Tue Sep 13 07:03:47 2022] GET /compute/v2.1/servers => generated 342 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:03:48.352331 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e780d165-8cc9-42c6-ae61-650a5fbbae3a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:48.353388 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e780d165-8cc9-42c6-ae61-650a5fbbae3a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:48.362107 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e780d165-8cc9-42c6-ae61-650a5fbbae3a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:48.363021 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e780d165-8cc9-42c6-ae61-650a5fbbae3a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:48.363672 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e780d165-8cc9-42c6-ae61-650a5fbbae3a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:48.365194 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e780d165-8cc9-42c6-ae61-650a5fbbae3a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:48.366507 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e780d165-8cc9-42c6-ae61-650a5fbbae3a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:48.367360 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e780d165-8cc9-42c6-ae61-650a5fbbae3a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:48.394989 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=8 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:48.897466 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e780d165-8cc9-42c6-ae61-650a5fbbae3a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:48.909625 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e780d165-8cc9-42c6-ae61-650a5fbbae3a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1546 microversion: 2.1 time: 0.563309 Sep 13 07:03:48.914532 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 177/376] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:48 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1546 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:48.943288 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-384b241e-cd96-445a-b534-082f612d7317 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:48.943526 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-de04bb89-bf67-4715-9476-46e90c5083ec tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:48.945157 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-384b241e-cd96-445a-b534-082f612d7317 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:48.960143 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-de04bb89-bf67-4715-9476-46e90c5083ec tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1371 microversion: 2.1 time: 0.942380 Sep 13 07:03:48.960739 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 200/377] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:48 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1371 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:48.966980 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-384b241e-cd96-445a-b534-082f612d7317 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:48.970725 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-384b241e-cd96-445a-b534-082f612d7317 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:48.971392 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-384b241e-cd96-445a-b534-082f612d7317 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:48.972336 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-384b241e-cd96-445a-b534-082f612d7317 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:48.972993 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-384b241e-cd96-445a-b534-082f612d7317 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:48.977369 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-384b241e-cd96-445a-b534-082f612d7317 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:49.018016 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-48069a97-ed59-49e9-8676-9dafddff31ad tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:49.032564 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-48069a97-ed59-49e9-8676-9dafddff31ad tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:49.047881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48069a97-ed59-49e9-8676-9dafddff31ad tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:49.048825 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48069a97-ed59-49e9-8676-9dafddff31ad tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:49.049441 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48069a97-ed59-49e9-8676-9dafddff31ad tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:49.050504 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48069a97-ed59-49e9-8676-9dafddff31ad tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:49.051134 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48069a97-ed59-49e9-8676-9dafddff31ad tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:49.051734 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48069a97-ed59-49e9-8676-9dafddff31ad tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:49.686614 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-384b241e-cd96-445a-b534-082f612d7317 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:49.704175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-384b241e-cd96-445a-b534-082f612d7317 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1314 microversion: 2.1 time: 0.785935 Sep 13 07:03:49.704773 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 178/378] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:48 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1314 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:49.722465 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-54a0d985-c2e9-4dfb-8c77-6cddeb08e4ae req-095281c4-107a-443e-af45-664d85dbe2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd7bdba-2bb2-4f07-91d6-259c3af250e8", "tag": "e4be0638-9439-4862-aa49-a64acec3c3ee"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:03:49.758173 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-54a0d985-c2e9-4dfb-8c77-6cddeb08e4ae req-095281c4-107a-443e-af45-664d85dbe2d4 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:49.758611 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-54a0d985-c2e9-4dfb-8c77-6cddeb08e4ae req-095281c4-107a-443e-af45-664d85dbe2d4 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:49.758766 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-54a0d985-c2e9-4dfb-8c77-6cddeb08e4ae req-095281c4-107a-443e-af45-664d85dbe2d4 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:49.796696 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-48069a97-ed59-49e9-8676-9dafddff31ad tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:49.809835 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-48069a97-ed59-49e9-8676-9dafddff31ad tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:49.810854 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-54a0d985-c2e9-4dfb-8c77-6cddeb08e4ae req-095281c4-107a-443e-af45-664d85dbe2d4 service nova] Creating event network-changed:e4be0638-9439-4862-aa49-a64acec3c3ee for instance 8cd7bdba-2bb2-4f07-91d6-259c3af250e8 on hv-cinder-85694 Sep 13 07:03:49.818938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-48069a97-ed59-49e9-8676-9dafddff31ad tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:49.821266 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-54a0d985-c2e9-4dfb-8c77-6cddeb08e4ae req-095281c4-107a-443e-af45-664d85dbe2d4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115248 Sep 13 07:03:49.824720 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-48069a97-ed59-49e9-8676-9dafddff31ad tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1739 microversion: 2.20 time: 0.807868 Sep 13 07:03:49.828833 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 201/379] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:49 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1739 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:03:49.832654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 179/380] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:03:49.993509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-57499dc8-5e7b-4a0e-aff2-5e3173b1e9c9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:49.994416 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-57499dc8-5e7b-4a0e-aff2-5e3173b1e9c9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:50.016202 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57499dc8-5e7b-4a0e-aff2-5e3173b1e9c9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:50.016716 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57499dc8-5e7b-4a0e-aff2-5e3173b1e9c9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:50.017150 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57499dc8-5e7b-4a0e-aff2-5e3173b1e9c9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:50.017868 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57499dc8-5e7b-4a0e-aff2-5e3173b1e9c9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:50.018339 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57499dc8-5e7b-4a0e-aff2-5e3173b1e9c9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:50.018755 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57499dc8-5e7b-4a0e-aff2-5e3173b1e9c9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:50.549466 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-57499dc8-5e7b-4a0e-aff2-5e3173b1e9c9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:50.575723 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-57499dc8-5e7b-4a0e-aff2-5e3173b1e9c9 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1371 microversion: 2.1 time: 0.585752 Sep 13 07:03:50.577640 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 202/381] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:49 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1371 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:03:50.737948 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-45862d38-894c-4a17-8d14-c5b44a236b08 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:50.739177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-45862d38-894c-4a17-8d14-c5b44a236b08 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:50.762234 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-45862d38-894c-4a17-8d14-c5b44a236b08 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:50.762892 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-45862d38-894c-4a17-8d14-c5b44a236b08 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:50.763423 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-45862d38-894c-4a17-8d14-c5b44a236b08 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:50.764249 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-45862d38-894c-4a17-8d14-c5b44a236b08 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:50.764832 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-45862d38-894c-4a17-8d14-c5b44a236b08 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:50.765524 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-45862d38-894c-4a17-8d14-c5b44a236b08 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:50.828398 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=100 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:50.857756 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1ca8bc5f-81f3-4d19-81ce-057678c9db55 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:50.859550 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1ca8bc5f-81f3-4d19-81ce-057678c9db55 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:50.868237 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1ca8bc5f-81f3-4d19-81ce-057678c9db55 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:50.869205 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1ca8bc5f-81f3-4d19-81ce-057678c9db55 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:50.870136 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1ca8bc5f-81f3-4d19-81ce-057678c9db55 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:50.872790 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1ca8bc5f-81f3-4d19-81ce-057678c9db55 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:50.873571 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1ca8bc5f-81f3-4d19-81ce-057678c9db55 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:50.875087 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1ca8bc5f-81f3-4d19-81ce-057678c9db55 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:51.667486 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-45862d38-894c-4a17-8d14-c5b44a236b08 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:51.679883 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-45862d38-894c-4a17-8d14-c5b44a236b08 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1314 microversion: 2.1 time: 0.950824 Sep 13 07:03:51.681485 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 180/382] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:50 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1314 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:51.685872 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1ca8bc5f-81f3-4d19-81ce-057678c9db55 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:51.698426 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1ca8bc5f-81f3-4d19-81ce-057678c9db55 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:51.699503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2cb89b9f-3dc9-463a-880e-66ccf1420c50 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9947bd7b-0a3d-468c-ba4a-f89f52c6f387"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:03:51.702189 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1ca8bc5f-81f3-4d19-81ce-057678c9db55 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:51.702984 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2cb89b9f-3dc9-463a-880e-66ccf1420c50 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:51.703804 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1ca8bc5f-81f3-4d19-81ce-057678c9db55 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1739 microversion: 2.20 time: 0.851197 Sep 13 07:03:51.704868 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 203/383] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:50 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1739 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:03:51.709787 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-54566bb7-0189-4966-b120-4048ece89185 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:51.711274 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-54566bb7-0189-4966-b120-4048ece89185 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:51.715512 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2cb89b9f-3dc9-463a-880e-66ccf1420c50 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:51.718540 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2cb89b9f-3dc9-463a-880e-66ccf1420c50 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:51.721168 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2cb89b9f-3dc9-463a-880e-66ccf1420c50 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:51.722205 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2cb89b9f-3dc9-463a-880e-66ccf1420c50 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:51.723824 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54566bb7-0189-4966-b120-4048ece89185 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:51.724483 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2cb89b9f-3dc9-463a-880e-66ccf1420c50 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:51.724821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54566bb7-0189-4966-b120-4048ece89185 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:51.724961 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2cb89b9f-3dc9-463a-880e-66ccf1420c50 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:51.725537 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54566bb7-0189-4966-b120-4048ece89185 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:51.726500 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54566bb7-0189-4966-b120-4048ece89185 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:51.727143 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54566bb7-0189-4966-b120-4048ece89185 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:51.727882 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54566bb7-0189-4966-b120-4048ece89185 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:51.957779 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-54566bb7-0189-4966-b120-4048ece89185 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:51.974112 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-54566bb7-0189-4966-b120-4048ece89185 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1371 microversion: 2.1 time: 0.267867 Sep 13 07:03:51.977232 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 204/384] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:51 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1371 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:52.014342 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-dc600d10-15d5-4952-9bf4-f6c0ba225d63 req-d5099630-2283-4988-a4be-fde2f3b02953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67e34c0a-348c-45fc-bbf9-d62e9444353d", "tag": "3752b644-8fe8-4689-a57a-05924b3e4a27"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:03:52.025741 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-dc600d10-15d5-4952-9bf4-f6c0ba225d63 req-d5099630-2283-4988-a4be-fde2f3b02953 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:52.027079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-dc600d10-15d5-4952-9bf4-f6c0ba225d63 req-d5099630-2283-4988-a4be-fde2f3b02953 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:52.027734 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-dc600d10-15d5-4952-9bf4-f6c0ba225d63 req-d5099630-2283-4988-a4be-fde2f3b02953 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:52.048411 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-dc600d10-15d5-4952-9bf4-f6c0ba225d63 req-d5099630-2283-4988-a4be-fde2f3b02953 service nova] Creating event network-changed:3752b644-8fe8-4689-a57a-05924b3e4a27 for instance 67e34c0a-348c-45fc-bbf9-d62e9444353d on hv-cinder-85694 Sep 13 07:03:52.063232 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-dc600d10-15d5-4952-9bf4-f6c0ba225d63 req-d5099630-2283-4988-a4be-fde2f3b02953 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069294 Sep 13 07:03:52.064111 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 205/385] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:03:52.724386 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-16f238eb-2b3f-4ec6-a546-8193e6fdf333 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:52.724969 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-16f238eb-2b3f-4ec6-a546-8193e6fdf333 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:52.741135 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-16f238eb-2b3f-4ec6-a546-8193e6fdf333 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:52.742845 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-16f238eb-2b3f-4ec6-a546-8193e6fdf333 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:52.743507 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-16f238eb-2b3f-4ec6-a546-8193e6fdf333 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:52.744572 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-16f238eb-2b3f-4ec6-a546-8193e6fdf333 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:52.745311 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-16f238eb-2b3f-4ec6-a546-8193e6fdf333 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:52.745912 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-16f238eb-2b3f-4ec6-a546-8193e6fdf333 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:52.941034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-16f238eb-2b3f-4ec6-a546-8193e6fdf333 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:52.950936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-16f238eb-2b3f-4ec6-a546-8193e6fdf333 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1314 microversion: 2.1 time: 0.231315 Sep 13 07:03:52.972427 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 206/386] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:52 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:52.982474 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9488f634-9218-4c0e-b32b-f70f9d11f905 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:52.983336 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9488f634-9218-4c0e-b32b-f70f9d11f905 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:53.000667 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9488f634-9218-4c0e-b32b-f70f9d11f905 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:53.001356 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9488f634-9218-4c0e-b32b-f70f9d11f905 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:53.002969 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9488f634-9218-4c0e-b32b-f70f9d11f905 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:53.003884 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9488f634-9218-4c0e-b32b-f70f9d11f905 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:53.004879 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9488f634-9218-4c0e-b32b-f70f9d11f905 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:53.005461 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9488f634-9218-4c0e-b32b-f70f9d11f905 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:53.237786 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9488f634-9218-4c0e-b32b-f70f9d11f905 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:53.252634 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9488f634-9218-4c0e-b32b-f70f9d11f905 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:53.255757 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9488f634-9218-4c0e-b32b-f70f9d11f905 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:53.268136 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9488f634-9218-4c0e-b32b-f70f9d11f905 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1739 microversion: 2.20 time: 0.285830 Sep 13 07:03:53.269391 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 207/387] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:52 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1739 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:03:53.292630 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3b33d03d-899a-443d-854b-837fd2271c33 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:53.293504 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3b33d03d-899a-443d-854b-837fd2271c33 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:53.300818 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b33d03d-899a-443d-854b-837fd2271c33 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:53.301590 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b33d03d-899a-443d-854b-837fd2271c33 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:53.302223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b33d03d-899a-443d-854b-837fd2271c33 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:53.303092 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b33d03d-899a-443d-854b-837fd2271c33 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:53.303699 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b33d03d-899a-443d-854b-837fd2271c33 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:53.304975 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b33d03d-899a-443d-854b-837fd2271c33 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:53.542466 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3b33d03d-899a-443d-854b-837fd2271c33 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:53.569885 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3b33d03d-899a-443d-854b-837fd2271c33 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1371 microversion: 2.1 time: 0.281003 Sep 13 07:03:53.570789 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 208/388] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:53 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1371 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:53.979755 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8e7ff9d5-26f6-4781-965f-9511ad58595c tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:53.981192 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8e7ff9d5-26f6-4781-965f-9511ad58595c tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:53.988083 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8e7ff9d5-26f6-4781-965f-9511ad58595c tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:53.988893 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8e7ff9d5-26f6-4781-965f-9511ad58595c tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:53.989325 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8e7ff9d5-26f6-4781-965f-9511ad58595c tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:53.990050 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8e7ff9d5-26f6-4781-965f-9511ad58595c tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:53.990546 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8e7ff9d5-26f6-4781-965f-9511ad58595c tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:53.990951 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8e7ff9d5-26f6-4781-965f-9511ad58595c tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:54.306577 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8e7ff9d5-26f6-4781-965f-9511ad58595c tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:54.351111 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8e7ff9d5-26f6-4781-965f-9511ad58595c tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1314 microversion: 2.1 time: 0.371703 Sep 13 07:03:54.356186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 209/389] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:53 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:54.380286 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-103c9b74-1aab-4547-bc7e-3b54ac163e44 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:54.381319 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-103c9b74-1aab-4547-bc7e-3b54ac163e44 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:54.402488 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-103c9b74-1aab-4547-bc7e-3b54ac163e44 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:54.403588 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-103c9b74-1aab-4547-bc7e-3b54ac163e44 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:54.404421 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-103c9b74-1aab-4547-bc7e-3b54ac163e44 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:54.405369 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-103c9b74-1aab-4547-bc7e-3b54ac163e44 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:54.406148 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-103c9b74-1aab-4547-bc7e-3b54ac163e44 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:54.406853 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-103c9b74-1aab-4547-bc7e-3b54ac163e44 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:54.532981 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2cb89b9f-3dc9-463a-880e-66ccf1420c50 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "POST /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.848910 Sep 13 07:03:54.533593 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 181/390] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Sep 13 07:03:51 2022] POST /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015/os-volume_attachments => generated 194 bytes in 2851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:03:54.614161 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f69b14e0-cec5-4c01-9b55-a86bb86447d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:54.614991 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f69b14e0-cec5-4c01-9b55-a86bb86447d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:54.630973 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f69b14e0-cec5-4c01-9b55-a86bb86447d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:54.632035 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f69b14e0-cec5-4c01-9b55-a86bb86447d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:54.633674 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f69b14e0-cec5-4c01-9b55-a86bb86447d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:54.634840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f69b14e0-cec5-4c01-9b55-a86bb86447d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:54.635797 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f69b14e0-cec5-4c01-9b55-a86bb86447d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:54.636432 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f69b14e0-cec5-4c01-9b55-a86bb86447d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:55.593835 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-103c9b74-1aab-4547-bc7e-3b54ac163e44 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:55.614943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-103c9b74-1aab-4547-bc7e-3b54ac163e44 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:55.617078 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-103c9b74-1aab-4547-bc7e-3b54ac163e44 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:55.619012 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-103c9b74-1aab-4547-bc7e-3b54ac163e44 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1739 microversion: 2.20 time: 1.261569 Sep 13 07:03:55.620432 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 210/391] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:54 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1739 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:03:55.634062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3e7b53b9-c076-488b-aa0e-c82afa29fb53 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:55.635129 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3e7b53b9-c076-488b-aa0e-c82afa29fb53 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:55.639926 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f69b14e0-cec5-4c01-9b55-a86bb86447d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:55.647222 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e7b53b9-c076-488b-aa0e-c82afa29fb53 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:55.648165 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e7b53b9-c076-488b-aa0e-c82afa29fb53 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:55.649359 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e7b53b9-c076-488b-aa0e-c82afa29fb53 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:55.650339 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e7b53b9-c076-488b-aa0e-c82afa29fb53 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:55.651175 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e7b53b9-c076-488b-aa0e-c82afa29fb53 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:55.651847 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e7b53b9-c076-488b-aa0e-c82afa29fb53 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:55.663243 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f69b14e0-cec5-4c01-9b55-a86bb86447d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1371 microversion: 2.1 time: 1.061448 Sep 13 07:03:55.663363 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 182/392] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:54 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1371 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:55.985746 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3e7b53b9-c076-488b-aa0e-c82afa29fb53 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:55.997492 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3e7b53b9-c076-488b-aa0e-c82afa29fb53 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1314 microversion: 2.1 time: 0.375475 Sep 13 07:03:55.998098 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 211/393] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:55 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:56.645373 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3a970986-1e86-40b1-b51b-6ea423bcb736 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:56.645999 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3a970986-1e86-40b1-b51b-6ea423bcb736 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:56.667881 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a970986-1e86-40b1-b51b-6ea423bcb736 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:56.678148 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a970986-1e86-40b1-b51b-6ea423bcb736 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:56.690781 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4ce4fe33-97c3-44b8-89ee-268ffec8ebd0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:56.692139 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4ce4fe33-97c3-44b8-89ee-268ffec8ebd0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:56.697574 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a970986-1e86-40b1-b51b-6ea423bcb736 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:56.702660 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ce4fe33-97c3-44b8-89ee-268ffec8ebd0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:56.703017 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a970986-1e86-40b1-b51b-6ea423bcb736 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:56.703581 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ce4fe33-97c3-44b8-89ee-268ffec8ebd0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:56.705679 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a970986-1e86-40b1-b51b-6ea423bcb736 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:56.705824 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ce4fe33-97c3-44b8-89ee-268ffec8ebd0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:56.706511 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a970986-1e86-40b1-b51b-6ea423bcb736 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:56.707038 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ce4fe33-97c3-44b8-89ee-268ffec8ebd0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:56.707807 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ce4fe33-97c3-44b8-89ee-268ffec8ebd0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:56.708405 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ce4fe33-97c3-44b8-89ee-268ffec8ebd0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:57.085188 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4ce4fe33-97c3-44b8-89ee-268ffec8ebd0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:57.087057 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3a970986-1e86-40b1-b51b-6ea423bcb736 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:57.094294 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4ce4fe33-97c3-44b8-89ee-268ffec8ebd0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1371 microversion: 2.1 time: 0.408283 Sep 13 07:03:57.094873 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 212/394] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:56 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1371 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:57.099528 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3a970986-1e86-40b1-b51b-6ea423bcb736 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:57.104279 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3a970986-1e86-40b1-b51b-6ea423bcb736 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:57.107386 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3a970986-1e86-40b1-b51b-6ea423bcb736 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1721 microversion: 2.20 time: 0.467090 Sep 13 07:03:57.110117 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-5dfa3045-c1a0-4eeb-b045-92d2e1f61271 req-87cfce9b-16ab-4410-b06b-6d844f2338b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e34c0a-348c-45fc-bbf9-d62e9444353d", "name": "network-vif-plugged", "status": "completed", "tag": "3752b644-8fe8-4689-a57a-05924b3e4a27"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:03:57.119616 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 183/395] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:56 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1721 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:03:57.129978 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:57.132117 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-5dfa3045-c1a0-4eeb-b045-92d2e1f61271 req-87cfce9b-16ab-4410-b06b-6d844f2338b3 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:57.132752 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-5dfa3045-c1a0-4eeb-b045-92d2e1f61271 req-87cfce9b-16ab-4410-b06b-6d844f2338b3 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:57.133447 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-5dfa3045-c1a0-4eeb-b045-92d2e1f61271 req-87cfce9b-16ab-4410-b06b-6d844f2338b3 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:57.143472 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ac391e98-99de-44bb-b715-4ccf50dddc68 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:57.145294 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ac391e98-99de-44bb-b715-4ccf50dddc68 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:57.157705 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-5dfa3045-c1a0-4eeb-b045-92d2e1f61271 req-87cfce9b-16ab-4410-b06b-6d844f2338b3 service nova] Creating event network-vif-plugged:3752b644-8fe8-4689-a57a-05924b3e4a27 for instance 67e34c0a-348c-45fc-bbf9-d62e9444353d on hv-cinder-85694 Sep 13 07:03:57.159858 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac391e98-99de-44bb-b715-4ccf50dddc68 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:57.160466 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac391e98-99de-44bb-b715-4ccf50dddc68 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:57.161063 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac391e98-99de-44bb-b715-4ccf50dddc68 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:57.161915 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac391e98-99de-44bb-b715-4ccf50dddc68 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:57.163157 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-5dfa3045-c1a0-4eeb-b045-92d2e1f61271 req-87cfce9b-16ab-4410-b06b-6d844f2338b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066201 Sep 13 07:03:57.163978 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 213/396] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:03:57.164584 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac391e98-99de-44bb-b715-4ccf50dddc68 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:57.165125 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac391e98-99de-44bb-b715-4ccf50dddc68 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:57.363136 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ac391e98-99de-44bb-b715-4ccf50dddc68 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:57.376082 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ac391e98-99de-44bb-b715-4ccf50dddc68 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1314 microversion: 2.1 time: 0.254847 Sep 13 07:03:57.377202 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 184/397] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:57 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:58.124625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-eabcea0e-6209-4c03-bf2e-cdefebb87c65 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:58.125441 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-eabcea0e-6209-4c03-bf2e-cdefebb87c65 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:58.136432 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eabcea0e-6209-4c03-bf2e-cdefebb87c65 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:58.137964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eabcea0e-6209-4c03-bf2e-cdefebb87c65 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:58.142746 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7b76ef10-b304-4de4-b4ff-8bf2a46e3886 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:58.143376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eabcea0e-6209-4c03-bf2e-cdefebb87c65 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:58.143523 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7b76ef10-b304-4de4-b4ff-8bf2a46e3886 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:58.144320 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eabcea0e-6209-4c03-bf2e-cdefebb87c65 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:58.144871 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eabcea0e-6209-4c03-bf2e-cdefebb87c65 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:58.145382 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eabcea0e-6209-4c03-bf2e-cdefebb87c65 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:58.158441 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:58.174446 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7b76ef10-b304-4de4-b4ff-8bf2a46e3886 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:58.176975 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7b76ef10-b304-4de4-b4ff-8bf2a46e3886 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:58.177459 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7b76ef10-b304-4de4-b4ff-8bf2a46e3886 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:58.186999 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7b76ef10-b304-4de4-b4ff-8bf2a46e3886 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:58.187533 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7b76ef10-b304-4de4-b4ff-8bf2a46e3886 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:58.191307 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7b76ef10-b304-4de4-b4ff-8bf2a46e3886 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:58.514226 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-eabcea0e-6209-4c03-bf2e-cdefebb87c65 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:58.524674 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-eabcea0e-6209-4c03-bf2e-cdefebb87c65 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1371 microversion: 2.1 time: 0.407248 Sep 13 07:03:58.531841 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 214/398] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:58 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1371 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:58.548038 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-616d04a2-a486-4b60-8f7e-1fec200300da tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:58.558974 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-616d04a2-a486-4b60-8f7e-1fec200300da tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:58.577332 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-616d04a2-a486-4b60-8f7e-1fec200300da tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:58.578144 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-616d04a2-a486-4b60-8f7e-1fec200300da tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:58.579967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-616d04a2-a486-4b60-8f7e-1fec200300da tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:58.581745 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-616d04a2-a486-4b60-8f7e-1fec200300da tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:58.584205 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-616d04a2-a486-4b60-8f7e-1fec200300da tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:58.584816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-616d04a2-a486-4b60-8f7e-1fec200300da tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:58.597329 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7b76ef10-b304-4de4-b4ff-8bf2a46e3886 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:58.609005 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7b76ef10-b304-4de4-b4ff-8bf2a46e3886 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:58.610672 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7b76ef10-b304-4de4-b4ff-8bf2a46e3886 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:58.622922 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7b76ef10-b304-4de4-b4ff-8bf2a46e3886 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1721 microversion: 2.20 time: 0.484198 Sep 13 07:03:58.623775 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 185/399] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:58 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1721 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:03:58.800250 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-616d04a2-a486-4b60-8f7e-1fec200300da tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:58.804257 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:58.810535 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-616d04a2-a486-4b60-8f7e-1fec200300da tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1314 microversion: 2.1 time: 0.277098 Sep 13 07:03:58.811557 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 215/400] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:58 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:03:59.558963 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-beff8ccf-d26a-47c4-9550-84c6584365b6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:59.559774 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-beff8ccf-d26a-47c4-9550-84c6584365b6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:59.571511 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-beff8ccf-d26a-47c4-9550-84c6584365b6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:59.572028 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-beff8ccf-d26a-47c4-9550-84c6584365b6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:59.572724 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-beff8ccf-d26a-47c4-9550-84c6584365b6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:59.573463 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-beff8ccf-d26a-47c4-9550-84c6584365b6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:59.573920 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-beff8ccf-d26a-47c4-9550-84c6584365b6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:59.574380 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-beff8ccf-d26a-47c4-9550-84c6584365b6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:59.651051 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-12aa4886-1d55-45a7-ab02-9b120719b907 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:59.656719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-12aa4886-1d55-45a7-ab02-9b120719b907 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:59.664353 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12aa4886-1d55-45a7-ab02-9b120719b907 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:59.665111 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12aa4886-1d55-45a7-ab02-9b120719b907 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:59.665699 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12aa4886-1d55-45a7-ab02-9b120719b907 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:59.666874 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12aa4886-1d55-45a7-ab02-9b120719b907 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:59.667673 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12aa4886-1d55-45a7-ab02-9b120719b907 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:59.668249 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12aa4886-1d55-45a7-ab02-9b120719b907 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:59.821010 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-beff8ccf-d26a-47c4-9550-84c6584365b6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:59.830401 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-beff8ccf-d26a-47c4-9550-84c6584365b6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1371 microversion: 2.1 time: 0.275867 Sep 13 07:03:59.831806 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 186/401] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:59 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1371 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:03:59.838238 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2d6045c7-e9ff-46d7-bec8-5983a99e3aae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:03:59.839122 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2d6045c7-e9ff-46d7-bec8-5983a99e3aae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:03:59.845341 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2d6045c7-e9ff-46d7-bec8-5983a99e3aae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:59.846045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2d6045c7-e9ff-46d7-bec8-5983a99e3aae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:59.846822 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2d6045c7-e9ff-46d7-bec8-5983a99e3aae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:59.847759 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2d6045c7-e9ff-46d7-bec8-5983a99e3aae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:03:59.848512 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2d6045c7-e9ff-46d7-bec8-5983a99e3aae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:03:59.848932 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2d6045c7-e9ff-46d7-bec8-5983a99e3aae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:03:59.888669 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-12aa4886-1d55-45a7-ab02-9b120719b907 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:59.897833 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-12aa4886-1d55-45a7-ab02-9b120719b907 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:59.899799 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-12aa4886-1d55-45a7-ab02-9b120719b907 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:03:59.902417 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-12aa4886-1d55-45a7-ab02-9b120719b907 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1721 microversion: 2.20 time: 0.255315 Sep 13 07:03:59.919894 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 216/402] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:03:59 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1721 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:00.013575 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2d6045c7-e9ff-46d7-bec8-5983a99e3aae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:00.023735 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2d6045c7-e9ff-46d7-bec8-5983a99e3aae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1314 microversion: 2.1 time: 0.190714 Sep 13 07:04:00.026121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 187/403] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:03:59 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:00.648652 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6239f4ef-7fac-4beb-98d9-276964b0be73 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Action: 'create', calling method: .version_select at 0x7f4c199b7700>, body: {"keypair": {"name": "tempest-TestShelveInstance-1849819186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgTmKawzk2NvLW/xjamEpp44knBFGw/Gtbe2g6xSyiYG6hGYAJuROMC9g0urFUK8VVMR2rWN1dwbt00aj9ea/OdzhDgNAcp7EeYDYWWOiJ7IIe8AGDE8Mtc+JJdE/8RNA=="}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:00.664979 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-6239f4ef-7fac-4beb-98d9-276964b0be73 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Getting quotas for project 8e08bdf8d28f4a5093df2c5b26ccb9e6. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:04:00.669417 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-6239f4ef-7fac-4beb-98d9-276964b0be73 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Getting quotas for user a04d90d3f1e04a00b2ace1893ce5ef71 and project 8e08bdf8d28f4a5093df2c5b26ccb9e6. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:04:00.693553 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6239f4ef-7fac-4beb-98d9-276964b0be73 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.229821 Sep 13 07:04:00.694180 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 217/404] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Sep 13 07:04:00 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:04:00.856446 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b0f742da-5615-41a9-a237-a346f1291a46 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:00.857706 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b0f742da-5615-41a9-a237-a346f1291a46 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:00.866379 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b0f742da-5615-41a9-a237-a346f1291a46 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:00.866868 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b0f742da-5615-41a9-a237-a346f1291a46 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:00.867404 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b0f742da-5615-41a9-a237-a346f1291a46 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:00.867990 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b0f742da-5615-41a9-a237-a346f1291a46 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:00.868432 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b0f742da-5615-41a9-a237-a346f1291a46 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:00.869441 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b0f742da-5615-41a9-a237-a346f1291a46 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:00.933535 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0ae9bca2-9f79-422d-a80b-de2cf22d6262 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:00.934528 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0ae9bca2-9f79-422d-a80b-de2cf22d6262 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:00.942879 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0ae9bca2-9f79-422d-a80b-de2cf22d6262 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:00.943675 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0ae9bca2-9f79-422d-a80b-de2cf22d6262 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:00.944333 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0ae9bca2-9f79-422d-a80b-de2cf22d6262 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:00.945274 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0ae9bca2-9f79-422d-a80b-de2cf22d6262 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:00.945935 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0ae9bca2-9f79-422d-a80b-de2cf22d6262 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:00.946571 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0ae9bca2-9f79-422d-a80b-de2cf22d6262 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:01.228840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b0f742da-5615-41a9-a237-a346f1291a46 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:01.236734 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0ae9bca2-9f79-422d-a80b-de2cf22d6262 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:01.237064 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b0f742da-5615-41a9-a237-a346f1291a46 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1371 microversion: 2.1 time: 0.387306 Sep 13 07:04:01.246032 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0ae9bca2-9f79-422d-a80b-de2cf22d6262 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:01.247495 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0ae9bca2-9f79-422d-a80b-de2cf22d6262 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:01.248676 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0ae9bca2-9f79-422d-a80b-de2cf22d6262 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1721 microversion: 2.20 time: 0.321909 Sep 13 07:04:01.249234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 218/405] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:00 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1721 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:04:01.263083 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-53415446-d23e-4568-9fec-bfbbe21bc827 req-fa6b3d04-296c-4d0e-9acc-8cd0cab49c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d57882a-892f-4b45-a8ec-7b6f4b21b0ad", "name": "network-vif-unplugged", "status": "completed", "tag": "447e368f-71d6-49ce-be81-226ee22458f1"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:01.263919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 188/406] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:00 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1371 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:01.276193 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-145e560e-b341-4e2c-b83f-dfa6ffa42de5 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:01.277338 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-145e560e-b341-4e2c-b83f-dfa6ffa42de5 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:01.287472 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-145e560e-b341-4e2c-b83f-dfa6ffa42de5 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:01.288216 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-145e560e-b341-4e2c-b83f-dfa6ffa42de5 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:01.288773 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-53415446-d23e-4568-9fec-bfbbe21bc827 req-fa6b3d04-296c-4d0e-9acc-8cd0cab49c32 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:01.288935 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-145e560e-b341-4e2c-b83f-dfa6ffa42de5 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:01.289258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-53415446-d23e-4568-9fec-bfbbe21bc827 req-fa6b3d04-296c-4d0e-9acc-8cd0cab49c32 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:01.289655 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-53415446-d23e-4568-9fec-bfbbe21bc827 req-fa6b3d04-296c-4d0e-9acc-8cd0cab49c32 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:01.290131 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-145e560e-b341-4e2c-b83f-dfa6ffa42de5 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:01.291058 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-145e560e-b341-4e2c-b83f-dfa6ffa42de5 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:01.291646 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-145e560e-b341-4e2c-b83f-dfa6ffa42de5 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:01.324136 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-53415446-d23e-4568-9fec-bfbbe21bc827 req-fa6b3d04-296c-4d0e-9acc-8cd0cab49c32 service nova] Creating event network-vif-unplugged:447e368f-71d6-49ce-be81-226ee22458f1 for instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad on hv-cinder-85694 Sep 13 07:04:01.338435 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-53415446-d23e-4568-9fec-bfbbe21bc827 req-fa6b3d04-296c-4d0e-9acc-8cd0cab49c32 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082608 Sep 13 07:04:01.339189 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 219/407] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:04:01.473375 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-145e560e-b341-4e2c-b83f-dfa6ffa42de5 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:01.476918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-145e560e-b341-4e2c-b83f-dfa6ffa42de5 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1463 microversion: 2.1 time: 0.211625 Sep 13 07:04:01.482664 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 189/408] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:01 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1463 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:01.535265 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-857df105-1220-4a10-bb95-587ef80b8fe8 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:01.535837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-857df105-1220-4a10-bb95-587ef80b8fe8 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:01.543362 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-857df105-1220-4a10-bb95-587ef80b8fe8 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:01.544073 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-857df105-1220-4a10-bb95-587ef80b8fe8 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:01.544727 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-857df105-1220-4a10-bb95-587ef80b8fe8 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:01.545874 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-857df105-1220-4a10-bb95-587ef80b8fe8 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:01.546539 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-857df105-1220-4a10-bb95-587ef80b8fe8 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:01.547012 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-857df105-1220-4a10-bb95-587ef80b8fe8 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:01.577421 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-857df105-1220-4a10-bb95-587ef80b8fe8 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:04:01.671926 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-857df105-1220-4a10-bb95-587ef80b8fe8 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "DELETE /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 204 len: 0 microversion: 2.1 time: 0.140584 Sep 13 07:04:01.672642 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 220/409] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:04:01 2022] DELETE /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:04:01.682961 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c748825a-9a3e-4ce3-bea8-0702320caccd tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:01.683601 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c748825a-9a3e-4ce3-bea8-0702320caccd tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:01.686256 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=87 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:01.692404 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c748825a-9a3e-4ce3-bea8-0702320caccd tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:01.692906 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c748825a-9a3e-4ce3-bea8-0702320caccd tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:01.694291 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c748825a-9a3e-4ce3-bea8-0702320caccd tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:01.694291 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c748825a-9a3e-4ce3-bea8-0702320caccd tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:01.694542 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c748825a-9a3e-4ce3-bea8-0702320caccd tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:01.694940 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c748825a-9a3e-4ce3-bea8-0702320caccd tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:01.908867 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c748825a-9a3e-4ce3-bea8-0702320caccd tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:01.918022 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c748825a-9a3e-4ce3-bea8-0702320caccd tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1469 microversion: 2.1 time: 0.239784 Sep 13 07:04:01.918631 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 190/410] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:01 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1469 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:02.266753 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-838b3652-4a57-45ea-90cb-dab9ae3d25de tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:02.267533 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-838b3652-4a57-45ea-90cb-dab9ae3d25de tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:02.277412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-dc5b9aa6-b127-42ff-9067-35b0c2fa5a1e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:02.278025 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-dc5b9aa6-b127-42ff-9067-35b0c2fa5a1e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:02.281688 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-838b3652-4a57-45ea-90cb-dab9ae3d25de tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:02.282553 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-838b3652-4a57-45ea-90cb-dab9ae3d25de tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:02.283615 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-838b3652-4a57-45ea-90cb-dab9ae3d25de tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:02.288219 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-838b3652-4a57-45ea-90cb-dab9ae3d25de tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:02.290577 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-838b3652-4a57-45ea-90cb-dab9ae3d25de tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:02.291072 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-838b3652-4a57-45ea-90cb-dab9ae3d25de tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:02.293807 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dc5b9aa6-b127-42ff-9067-35b0c2fa5a1e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:02.296428 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dc5b9aa6-b127-42ff-9067-35b0c2fa5a1e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:02.297093 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dc5b9aa6-b127-42ff-9067-35b0c2fa5a1e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:02.298040 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dc5b9aa6-b127-42ff-9067-35b0c2fa5a1e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:02.301447 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dc5b9aa6-b127-42ff-9067-35b0c2fa5a1e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:02.302150 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dc5b9aa6-b127-42ff-9067-35b0c2fa5a1e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:02.619717 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-dc5b9aa6-b127-42ff-9067-35b0c2fa5a1e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:02.633015 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-dc5b9aa6-b127-42ff-9067-35b0c2fa5a1e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:02.634500 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-dc5b9aa6-b127-42ff-9067-35b0c2fa5a1e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:02.635992 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-838b3652-4a57-45ea-90cb-dab9ae3d25de tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:02.636165 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-dc5b9aa6-b127-42ff-9067-35b0c2fa5a1e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1724 microversion: 2.20 time: 0.363038 Sep 13 07:04:02.636877 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 191/411] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:02 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1724 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:04:02.649401 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-838b3652-4a57-45ea-90cb-dab9ae3d25de tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1371 microversion: 2.1 time: 0.387805 Sep 13 07:04:02.652522 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 221/412] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:02 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1371 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:02.670213 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-64e8ba89-205a-44ae-bbd1-6b9cbad5fc1f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4a9ee8e-5ad9-4628-804d-2785e552e047"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:02.672973 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-64e8ba89-205a-44ae-bbd1-6b9cbad5fc1f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:02.684555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64e8ba89-205a-44ae-bbd1-6b9cbad5fc1f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:02.685198 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64e8ba89-205a-44ae-bbd1-6b9cbad5fc1f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:02.685884 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64e8ba89-205a-44ae-bbd1-6b9cbad5fc1f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:02.686774 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64e8ba89-205a-44ae-bbd1-6b9cbad5fc1f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:02.690679 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64e8ba89-205a-44ae-bbd1-6b9cbad5fc1f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:02.691353 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64e8ba89-205a-44ae-bbd1-6b9cbad5fc1f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:02.941564 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c0e7daa8-92da-4c99-855c-b8c0ef0f09ff tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:02.943000 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c0e7daa8-92da-4c99-855c-b8c0ef0f09ff tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:02.978341 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0e7daa8-92da-4c99-855c-b8c0ef0f09ff tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:02.979369 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0e7daa8-92da-4c99-855c-b8c0ef0f09ff tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:02.979830 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0e7daa8-92da-4c99-855c-b8c0ef0f09ff tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:02.990589 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0e7daa8-92da-4c99-855c-b8c0ef0f09ff tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:02.991460 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0e7daa8-92da-4c99-855c-b8c0ef0f09ff tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:02.992309 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0e7daa8-92da-4c99-855c-b8c0ef0f09ff tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:03.235000 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c0e7daa8-92da-4c99-855c-b8c0ef0f09ff tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:03.243384 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c0e7daa8-92da-4c99-855c-b8c0ef0f09ff tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1469 microversion: 2.1 time: 0.305623 Sep 13 07:04:03.244767 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 222/413] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:02 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1469 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:04:03.355503 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-ce15190d-e953-4a31-bdc2-36ac66a30b7b req-4257c361-340b-42c4-9a01-865f05f85543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd7bdba-2bb2-4f07-91d6-259c3af250e8", "name": "network-vif-plugged", "status": "completed", "tag": "e4be0638-9439-4862-aa49-a64acec3c3ee"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:03.365682 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-ce15190d-e953-4a31-bdc2-36ac66a30b7b req-4257c361-340b-42c4-9a01-865f05f85543 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:03.366188 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-ce15190d-e953-4a31-bdc2-36ac66a30b7b req-4257c361-340b-42c4-9a01-865f05f85543 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:03.366631 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-ce15190d-e953-4a31-bdc2-36ac66a30b7b req-4257c361-340b-42c4-9a01-865f05f85543 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:03.383273 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-ce15190d-e953-4a31-bdc2-36ac66a30b7b req-4257c361-340b-42c4-9a01-865f05f85543 service nova] Creating event network-vif-plugged:e4be0638-9439-4862-aa49-a64acec3c3ee for instance 8cd7bdba-2bb2-4f07-91d6-259c3af250e8 on hv-cinder-85694 Sep 13 07:04:03.390500 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-ce15190d-e953-4a31-bdc2-36ac66a30b7b req-4257c361-340b-42c4-9a01-865f05f85543 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038924 Sep 13 07:04:03.391298 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 223/414] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:04:03.421884 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-64e8ba89-205a-44ae-bbd1-6b9cbad5fc1f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "POST /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.759996 Sep 13 07:04:03.428143 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 192/415] 10.222.0.25 () {62 vars in 1364 bytes} [Tue Sep 13 07:04:02 2022] POST /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad/os-volume_attachments => generated 188 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:04:03.557617 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c0f8991a-ed81-4bb2-bb38-a57508faf186 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:03.558328 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c0f8991a-ed81-4bb2-bb38-a57508faf186 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:03.564607 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0f8991a-ed81-4bb2-bb38-a57508faf186 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:03.565080 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0f8991a-ed81-4bb2-bb38-a57508faf186 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:03.565502 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0f8991a-ed81-4bb2-bb38-a57508faf186 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:03.566267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0f8991a-ed81-4bb2-bb38-a57508faf186 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:03.566703 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0f8991a-ed81-4bb2-bb38-a57508faf186 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:03.567115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0f8991a-ed81-4bb2-bb38-a57508faf186 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:03.611706 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c0f8991a-ed81-4bb2-bb38-a57508faf186 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120696) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 07:04:03.677451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d114ed87-b6fb-468c-9857-4795a76f740d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:03.677921 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d114ed87-b6fb-468c-9857-4795a76f740d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:03.684723 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d114ed87-b6fb-468c-9857-4795a76f740d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:03.685195 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d114ed87-b6fb-468c-9857-4795a76f740d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:03.685871 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d114ed87-b6fb-468c-9857-4795a76f740d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:03.686858 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d114ed87-b6fb-468c-9857-4795a76f740d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:03.687649 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d114ed87-b6fb-468c-9857-4795a76f740d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:03.688798 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d114ed87-b6fb-468c-9857-4795a76f740d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:03.703819 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c0f8991a-ed81-4bb2-bb38-a57508faf186 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "POST /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad/action" status: 202 len: 0 microversion: 2.20 time: 0.142213 Sep 13 07:04:03.704696 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 224/416] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Sep 13 07:04:03 2022] POST /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:04:03.712357 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:03.712960 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-30cfb627-6dc5-4d02-a6ba-dab28275eab5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:03.713949 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-30cfb627-6dc5-4d02-a6ba-dab28275eab5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:03.720564 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-30cfb627-6dc5-4d02-a6ba-dab28275eab5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:03.721054 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-30cfb627-6dc5-4d02-a6ba-dab28275eab5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:03.721514 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-30cfb627-6dc5-4d02-a6ba-dab28275eab5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:03.722243 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-30cfb627-6dc5-4d02-a6ba-dab28275eab5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:03.722892 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-30cfb627-6dc5-4d02-a6ba-dab28275eab5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:03.723280 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-30cfb627-6dc5-4d02-a6ba-dab28275eab5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:03.913562 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d114ed87-b6fb-468c-9857-4795a76f740d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:03.922356 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d114ed87-b6fb-468c-9857-4795a76f740d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1371 microversion: 2.1 time: 0.248851 Sep 13 07:04:03.924302 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 193/417] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:03 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1371 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:04:03.928986 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-30cfb627-6dc5-4d02-a6ba-dab28275eab5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:03.951308 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-30cfb627-6dc5-4d02-a6ba-dab28275eab5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:03.955175 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-30cfb627-6dc5-4d02-a6ba-dab28275eab5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:03.956588 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-30cfb627-6dc5-4d02-a6ba-dab28275eab5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1810 microversion: 2.20 time: 0.247797 Sep 13 07:04:03.957186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 225/418] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:03 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1810 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:04:04.273030 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6aad1645-c85c-4ed3-af23-d4eadb5e0086 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:04.273647 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6aad1645-c85c-4ed3-af23-d4eadb5e0086 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:04.289584 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6aad1645-c85c-4ed3-af23-d4eadb5e0086 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:04.290073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6aad1645-c85c-4ed3-af23-d4eadb5e0086 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:04.290724 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6aad1645-c85c-4ed3-af23-d4eadb5e0086 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:04.292093 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6aad1645-c85c-4ed3-af23-d4eadb5e0086 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:04.292571 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6aad1645-c85c-4ed3-af23-d4eadb5e0086 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:04.293171 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6aad1645-c85c-4ed3-af23-d4eadb5e0086 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:04.525124 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6aad1645-c85c-4ed3-af23-d4eadb5e0086 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:04.535424 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6aad1645-c85c-4ed3-af23-d4eadb5e0086 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1469 microversion: 2.1 time: 0.267078 Sep 13 07:04:04.536220 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 194/419] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:04 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1469 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:04.947380 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1a72e5f6-0786-4678-96c1-98939aba3b42 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:04.947999 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1a72e5f6-0786-4678-96c1-98939aba3b42 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:04.955044 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1a72e5f6-0786-4678-96c1-98939aba3b42 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:04.955669 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1a72e5f6-0786-4678-96c1-98939aba3b42 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:04.955946 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1a72e5f6-0786-4678-96c1-98939aba3b42 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:04.956696 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1a72e5f6-0786-4678-96c1-98939aba3b42 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:04.957134 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1a72e5f6-0786-4678-96c1-98939aba3b42 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:04.957552 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1a72e5f6-0786-4678-96c1-98939aba3b42 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:04.981657 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d5ee72d6-ea17-47f9-b105-1957dfd4e46c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:04.982636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d5ee72d6-ea17-47f9-b105-1957dfd4e46c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:04.989527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5ee72d6-ea17-47f9-b105-1957dfd4e46c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:04.990531 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5ee72d6-ea17-47f9-b105-1957dfd4e46c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:04.991167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5ee72d6-ea17-47f9-b105-1957dfd4e46c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:04.992154 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5ee72d6-ea17-47f9-b105-1957dfd4e46c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:04.992884 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5ee72d6-ea17-47f9-b105-1957dfd4e46c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:04.993524 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5ee72d6-ea17-47f9-b105-1957dfd4e46c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:05.168224 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1a72e5f6-0786-4678-96c1-98939aba3b42 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:05.184006 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d5ee72d6-ea17-47f9-b105-1957dfd4e46c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:05.185074 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1a72e5f6-0786-4678-96c1-98939aba3b42 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1371 microversion: 2.1 time: 0.234616 Sep 13 07:04:05.189083 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 226/420] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:04 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:05.196026 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d5ee72d6-ea17-47f9-b105-1957dfd4e46c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:05.198010 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d5ee72d6-ea17-47f9-b105-1957dfd4e46c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:05.199636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d5ee72d6-ea17-47f9-b105-1957dfd4e46c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1810 microversion: 2.20 time: 0.222064 Sep 13 07:04:05.200418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 195/421] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:04 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1810 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:05.564949 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ed3f6540-760a-479b-ba03-305996cfba45 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:05.565591 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ed3f6540-760a-479b-ba03-305996cfba45 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:05.571737 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ed3f6540-760a-479b-ba03-305996cfba45 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:05.572366 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ed3f6540-760a-479b-ba03-305996cfba45 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:05.572849 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ed3f6540-760a-479b-ba03-305996cfba45 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:05.573617 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ed3f6540-760a-479b-ba03-305996cfba45 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:05.574056 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ed3f6540-760a-479b-ba03-305996cfba45 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:05.574503 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ed3f6540-760a-479b-ba03-305996cfba45 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:05.716945 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ed3f6540-760a-479b-ba03-305996cfba45 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:05.727068 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ed3f6540-760a-479b-ba03-305996cfba45 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1469 microversion: 2.1 time: 0.165929 Sep 13 07:04:05.727781 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 227/422] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:05 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:06.211259 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-585d623e-f189-46af-993a-646755dac1e6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:06.211891 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-585d623e-f189-46af-993a-646755dac1e6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:06.219059 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-585d623e-f189-46af-993a-646755dac1e6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:06.219542 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-585d623e-f189-46af-993a-646755dac1e6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:06.219968 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-585d623e-f189-46af-993a-646755dac1e6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:06.220649 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-585d623e-f189-46af-993a-646755dac1e6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:06.221093 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-585d623e-f189-46af-993a-646755dac1e6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:06.221509 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-585d623e-f189-46af-993a-646755dac1e6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:06.225447 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-462a1441-b319-4b5b-b549-2d3ad567d36f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:06.226196 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-462a1441-b319-4b5b-b549-2d3ad567d36f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:06.233270 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-462a1441-b319-4b5b-b549-2d3ad567d36f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:06.233747 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-462a1441-b319-4b5b-b549-2d3ad567d36f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:06.234205 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-462a1441-b319-4b5b-b549-2d3ad567d36f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:06.234875 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-462a1441-b319-4b5b-b549-2d3ad567d36f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:06.235319 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-462a1441-b319-4b5b-b549-2d3ad567d36f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:06.235731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-462a1441-b319-4b5b-b549-2d3ad567d36f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:06.454481 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-585d623e-f189-46af-993a-646755dac1e6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:06.458036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-462a1441-b319-4b5b-b549-2d3ad567d36f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:06.462782 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-585d623e-f189-46af-993a-646755dac1e6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1371 microversion: 2.1 time: 0.255569 Sep 13 07:04:06.464191 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 196/423] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:06 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:06.468085 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-462a1441-b319-4b5b-b549-2d3ad567d36f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:06.469719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-462a1441-b319-4b5b-b549-2d3ad567d36f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:06.471192 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-462a1441-b319-4b5b-b549-2d3ad567d36f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1810 microversion: 2.20 time: 0.250232 Sep 13 07:04:06.471785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 228/424] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:06 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1810 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:06.751028 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9312ab84-c1c4-4377-93cd-c2c7a57075b5 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:06.751633 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9312ab84-c1c4-4377-93cd-c2c7a57075b5 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:06.758069 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9312ab84-c1c4-4377-93cd-c2c7a57075b5 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:06.758583 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9312ab84-c1c4-4377-93cd-c2c7a57075b5 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:06.759012 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9312ab84-c1c4-4377-93cd-c2c7a57075b5 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:06.759753 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9312ab84-c1c4-4377-93cd-c2c7a57075b5 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:06.760709 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9312ab84-c1c4-4377-93cd-c2c7a57075b5 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:06.761129 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9312ab84-c1c4-4377-93cd-c2c7a57075b5 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:06.894502 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9312ab84-c1c4-4377-93cd-c2c7a57075b5 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:06.902702 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9312ab84-c1c4-4377-93cd-c2c7a57075b5 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1469 microversion: 2.1 time: 0.155607 Sep 13 07:04:06.903265 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 197/425] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:06 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:07.486579 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b826ffd5-9e06-431b-8f81-d15d9812abde tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:07.487193 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b826ffd5-9e06-431b-8f81-d15d9812abde tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:07.496999 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b826ffd5-9e06-431b-8f81-d15d9812abde tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:07.497495 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b826ffd5-9e06-431b-8f81-d15d9812abde tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:07.497606 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bc96b58f-00d7-4d3e-8b5f-0200040f96a0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:07.498117 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b826ffd5-9e06-431b-8f81-d15d9812abde tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:07.498324 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bc96b58f-00d7-4d3e-8b5f-0200040f96a0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:07.498657 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b826ffd5-9e06-431b-8f81-d15d9812abde tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:07.499112 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b826ffd5-9e06-431b-8f81-d15d9812abde tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:07.499533 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b826ffd5-9e06-431b-8f81-d15d9812abde tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:07.508559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc96b58f-00d7-4d3e-8b5f-0200040f96a0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:07.509353 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc96b58f-00d7-4d3e-8b5f-0200040f96a0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:07.509795 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc96b58f-00d7-4d3e-8b5f-0200040f96a0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:07.510540 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc96b58f-00d7-4d3e-8b5f-0200040f96a0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:07.510980 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc96b58f-00d7-4d3e-8b5f-0200040f96a0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:07.511570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc96b58f-00d7-4d3e-8b5f-0200040f96a0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:07.703546 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b826ffd5-9e06-431b-8f81-d15d9812abde tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:07.715799 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bc96b58f-00d7-4d3e-8b5f-0200040f96a0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:07.718011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b826ffd5-9e06-431b-8f81-d15d9812abde tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1371 microversion: 2.1 time: 0.235431 Sep 13 07:04:07.720382 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 229/426] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:07 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:07.729996 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bc96b58f-00d7-4d3e-8b5f-0200040f96a0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:07.731503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bc96b58f-00d7-4d3e-8b5f-0200040f96a0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:07.732697 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bc96b58f-00d7-4d3e-8b5f-0200040f96a0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1810 microversion: 2.20 time: 0.239548 Sep 13 07:04:07.733741 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 198/427] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:07 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1810 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:07.930533 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e9729c6e-3ad3-4241-9d88-f2f2c281424f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:07.931904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e9729c6e-3ad3-4241-9d88-f2f2c281424f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:07.940654 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e9729c6e-3ad3-4241-9d88-f2f2c281424f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:07.941353 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e9729c6e-3ad3-4241-9d88-f2f2c281424f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:07.941934 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e9729c6e-3ad3-4241-9d88-f2f2c281424f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:07.942896 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e9729c6e-3ad3-4241-9d88-f2f2c281424f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:07.943493 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e9729c6e-3ad3-4241-9d88-f2f2c281424f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:07.944062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e9729c6e-3ad3-4241-9d88-f2f2c281424f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:08.089217 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e9729c6e-3ad3-4241-9d88-f2f2c281424f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:08.100946 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e9729c6e-3ad3-4241-9d88-f2f2c281424f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1469 microversion: 2.1 time: 0.175635 Sep 13 07:04:08.101581 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 230/428] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:07 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1469 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:08.742402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0e2c44f9-f847-4ec0-aabb-e63a40e3260a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:08.742995 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0e2c44f9-f847-4ec0-aabb-e63a40e3260a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:08.750244 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0e2c44f9-f847-4ec0-aabb-e63a40e3260a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:08.750728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0e2c44f9-f847-4ec0-aabb-e63a40e3260a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:08.751151 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0e2c44f9-f847-4ec0-aabb-e63a40e3260a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:08.751844 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0e2c44f9-f847-4ec0-aabb-e63a40e3260a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:08.752282 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0e2c44f9-f847-4ec0-aabb-e63a40e3260a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:08.752792 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0e2c44f9-f847-4ec0-aabb-e63a40e3260a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:08.762872 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-64f861fd-a0ec-4c36-bed0-16171350b430 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:08.764201 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-64f861fd-a0ec-4c36-bed0-16171350b430 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:08.771765 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-64f861fd-a0ec-4c36-bed0-16171350b430 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:08.772301 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-64f861fd-a0ec-4c36-bed0-16171350b430 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:08.772953 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-64f861fd-a0ec-4c36-bed0-16171350b430 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:08.773883 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-64f861fd-a0ec-4c36-bed0-16171350b430 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:08.774757 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-64f861fd-a0ec-4c36-bed0-16171350b430 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:08.775581 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-64f861fd-a0ec-4c36-bed0-16171350b430 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:09.328149 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-64f861fd-a0ec-4c36-bed0-16171350b430 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:09.337842 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-64f861fd-a0ec-4c36-bed0-16171350b430 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:09.339847 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-64f861fd-a0ec-4c36-bed0-16171350b430 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:09.346652 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0e2c44f9-f847-4ec0-aabb-e63a40e3260a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:09.347772 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-64f861fd-a0ec-4c36-bed0-16171350b430 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1810 microversion: 2.20 time: 0.588619 Sep 13 07:04:09.350569 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 231/429] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:08 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1810 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:04:09.355327 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6e1e61c9-b997-4381-b7a1-1b2c5897c055 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:09.356176 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6e1e61c9-b997-4381-b7a1-1b2c5897c055 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:09.370512 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e1e61c9-b997-4381-b7a1-1b2c5897c055 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:09.371283 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e1e61c9-b997-4381-b7a1-1b2c5897c055 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:09.371961 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e1e61c9-b997-4381-b7a1-1b2c5897c055 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:09.372669 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e1e61c9-b997-4381-b7a1-1b2c5897c055 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:09.372834 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0e2c44f9-f847-4ec0-aabb-e63a40e3260a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1371 microversion: 2.1 time: 0.634330 Sep 13 07:04:09.373282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e1e61c9-b997-4381-b7a1-1b2c5897c055 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:09.373424 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 199/430] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:08 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1371 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:09.374558 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e1e61c9-b997-4381-b7a1-1b2c5897c055 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:09.378998 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a302aadd-ace5-4f52-970a-fcc3d714e48f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:09.379547 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a302aadd-ace5-4f52-970a-fcc3d714e48f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:09.386395 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a302aadd-ace5-4f52-970a-fcc3d714e48f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:09.387148 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a302aadd-ace5-4f52-970a-fcc3d714e48f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:09.388248 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a302aadd-ace5-4f52-970a-fcc3d714e48f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:09.389838 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a302aadd-ace5-4f52-970a-fcc3d714e48f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:09.390670 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a302aadd-ace5-4f52-970a-fcc3d714e48f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:09.391261 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:09.391421 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a302aadd-ace5-4f52-970a-fcc3d714e48f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:09.467450 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a302aadd-ace5-4f52-970a-fcc3d714e48f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:09.476187 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a302aadd-ace5-4f52-970a-fcc3d714e48f tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1427 microversion: 2.1 time: 0.101478 Sep 13 07:04:09.476852 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 200/431] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:09 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:09.481920 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-e4744f24-6cc5-4ebe-9589-229f0a683323 req-41cdd0ad-b120-4450-821a-45d130a505b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e34c0a-348c-45fc-bbf9-d62e9444353d", "name": "network-vif-deleted", "tag": "3752b644-8fe8-4689-a57a-05924b3e4a27"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:09.495779 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-e4744f24-6cc5-4ebe-9589-229f0a683323 req-41cdd0ad-b120-4450-821a-45d130a505b7 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:09.496253 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-e4744f24-6cc5-4ebe-9589-229f0a683323 req-41cdd0ad-b120-4450-821a-45d130a505b7 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:09.496668 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-e4744f24-6cc5-4ebe-9589-229f0a683323 req-41cdd0ad-b120-4450-821a-45d130a505b7 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:09.513737 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-e4744f24-6cc5-4ebe-9589-229f0a683323 req-41cdd0ad-b120-4450-821a-45d130a505b7 service nova] Creating event network-vif-deleted:3752b644-8fe8-4689-a57a-05924b3e4a27 for instance 67e34c0a-348c-45fc-bbf9-d62e9444353d on hv-cinder-85694 Sep 13 07:04:09.527426 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-e4744f24-6cc5-4ebe-9589-229f0a683323 req-41cdd0ad-b120-4450-821a-45d130a505b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049034 Sep 13 07:04:09.528023 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 201/432] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:04:09.576891 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6e1e61c9-b997-4381-b7a1-1b2c5897c055 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:09.585173 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6e1e61c9-b997-4381-b7a1-1b2c5897c055 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1592 microversion: 2.1 time: 0.235164 Sep 13 07:04:09.586153 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 232/433] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:09 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1592 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:10.379229 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9484af37-09e2-4e97-a87a-dbb661af3fd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:10.380934 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9484af37-09e2-4e97-a87a-dbb661af3fd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:10.392633 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9484af37-09e2-4e97-a87a-dbb661af3fd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:10.393121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9484af37-09e2-4e97-a87a-dbb661af3fd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:10.393539 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9484af37-09e2-4e97-a87a-dbb661af3fd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:10.394282 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9484af37-09e2-4e97-a87a-dbb661af3fd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:10.395010 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9484af37-09e2-4e97-a87a-dbb661af3fd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:10.395362 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9484af37-09e2-4e97-a87a-dbb661af3fd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:10.403636 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7ee2c750-ad1b-47fb-8a81-dba1bb3e6550 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:10.405253 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7ee2c750-ad1b-47fb-8a81-dba1bb3e6550 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:10.413292 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ee2c750-ad1b-47fb-8a81-dba1bb3e6550 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:10.414797 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ee2c750-ad1b-47fb-8a81-dba1bb3e6550 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:10.414797 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ee2c750-ad1b-47fb-8a81-dba1bb3e6550 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:10.415238 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ee2c750-ad1b-47fb-8a81-dba1bb3e6550 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:10.415912 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ee2c750-ad1b-47fb-8a81-dba1bb3e6550 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:10.416674 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ee2c750-ad1b-47fb-8a81-dba1bb3e6550 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:10.634434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9484af37-09e2-4e97-a87a-dbb661af3fd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:10.643728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9484af37-09e2-4e97-a87a-dbb661af3fd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:10.645475 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9484af37-09e2-4e97-a87a-dbb661af3fd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:10.646926 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9484af37-09e2-4e97-a87a-dbb661af3fd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1750 microversion: 2.20 time: 0.274142 Sep 13 07:04:10.648093 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 202/434] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:10 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1750 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:10.649834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7ee2c750-ad1b-47fb-8a81-dba1bb3e6550 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:10.653438 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-af8a921c-2805-4f2a-806a-fc7cd02f3e82 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:10.654500 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-af8a921c-2805-4f2a-806a-fc7cd02f3e82 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:10.660452 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af8a921c-2805-4f2a-806a-fc7cd02f3e82 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:10.660835 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7ee2c750-ad1b-47fb-8a81-dba1bb3e6550 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1562 microversion: 2.1 time: 0.261879 Sep 13 07:04:10.661381 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af8a921c-2805-4f2a-806a-fc7cd02f3e82 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:10.661525 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 233/435] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:10 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1562 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:04:10.662278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af8a921c-2805-4f2a-806a-fc7cd02f3e82 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:10.663048 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af8a921c-2805-4f2a-806a-fc7cd02f3e82 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:10.663575 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af8a921c-2805-4f2a-806a-fc7cd02f3e82 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:10.664055 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af8a921c-2805-4f2a-806a-fc7cd02f3e82 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:10.690786 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-eec464d0-10cf-4323-956e-b018833dc960 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:10.691244 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-eec464d0-10cf-4323-956e-b018833dc960 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:10.696642 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=4 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:10.698615 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eec464d0-10cf-4323-956e-b018833dc960 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:10.699416 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eec464d0-10cf-4323-956e-b018833dc960 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:10.700119 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eec464d0-10cf-4323-956e-b018833dc960 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:10.701006 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eec464d0-10cf-4323-956e-b018833dc960 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:10.701631 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eec464d0-10cf-4323-956e-b018833dc960 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:10.702257 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eec464d0-10cf-4323-956e-b018833dc960 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:10.703493 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af8a921c-2805-4f2a-806a-fc7cd02f3e82 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:10.703974 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af8a921c-2805-4f2a-806a-fc7cd02f3e82 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:10.704399 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af8a921c-2805-4f2a-806a-fc7cd02f3e82 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:10.704831 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-af8a921c-2805-4f2a-806a-fc7cd02f3e82 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lazy-loading 'fault' on Instance uuid 67e34c0a-348c-45fc-bbf9-d62e9444353d {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:04:10.756970 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-af8a921c-2805-4f2a-806a-fc7cd02f3e82 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:10.766937 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-af8a921c-2805-4f2a-806a-fc7cd02f3e82 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1304 microversion: 2.1 time: 0.117459 Sep 13 07:04:10.767538 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 203/436] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:10 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:10.803883 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-eec464d0-10cf-4323-956e-b018833dc960 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117786 Sep 13 07:04:10.804505 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 234/437] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Sep 13 07:04:10 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:04:11.689329 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a75fa835-291a-4cc9-bc4f-f2a170d13f15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:11.690791 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a75fa835-291a-4cc9-bc4f-f2a170d13f15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:11.698361 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a75fa835-291a-4cc9-bc4f-f2a170d13f15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:11.699044 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a75fa835-291a-4cc9-bc4f-f2a170d13f15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:11.699605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a75fa835-291a-4cc9-bc4f-f2a170d13f15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:11.700436 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a75fa835-291a-4cc9-bc4f-f2a170d13f15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:11.701010 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a75fa835-291a-4cc9-bc4f-f2a170d13f15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:11.701556 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a75fa835-291a-4cc9-bc4f-f2a170d13f15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:11.792975 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-34a4e8d6-3f22-4085-8cad-88bd5a3e4fb1 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:11.795822 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-34a4e8d6-3f22-4085-8cad-88bd5a3e4fb1 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:11.804140 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34a4e8d6-3f22-4085-8cad-88bd5a3e4fb1 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:11.804629 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34a4e8d6-3f22-4085-8cad-88bd5a3e4fb1 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:11.805066 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34a4e8d6-3f22-4085-8cad-88bd5a3e4fb1 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:11.806165 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34a4e8d6-3f22-4085-8cad-88bd5a3e4fb1 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:11.806630 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34a4e8d6-3f22-4085-8cad-88bd5a3e4fb1 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:11.807045 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34a4e8d6-3f22-4085-8cad-88bd5a3e4fb1 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:11.854617 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34a4e8d6-3f22-4085-8cad-88bd5a3e4fb1 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:11.855086 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34a4e8d6-3f22-4085-8cad-88bd5a3e4fb1 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:11.855506 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34a4e8d6-3f22-4085-8cad-88bd5a3e4fb1 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:11.855940 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-34a4e8d6-3f22-4085-8cad-88bd5a3e4fb1 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lazy-loading 'fault' on Instance uuid 67e34c0a-348c-45fc-bbf9-d62e9444353d {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:04:11.859386 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a75fa835-291a-4cc9-bc4f-f2a170d13f15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:11.868772 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a75fa835-291a-4cc9-bc4f-f2a170d13f15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:11.870918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a75fa835-291a-4cc9-bc4f-f2a170d13f15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:11.872199 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a75fa835-291a-4cc9-bc4f-f2a170d13f15 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1752 microversion: 2.20 time: 0.187067 Sep 13 07:04:11.872810 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 204/438] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:11 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1752 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:11.900900 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-34a4e8d6-3f22-4085-8cad-88bd5a3e4fb1 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:11.908976 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-34a4e8d6-3f22-4085-8cad-88bd5a3e4fb1 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1304 microversion: 2.1 time: 0.121568 Sep 13 07:04:11.909569 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 235/439] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:11 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:12.812208 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-d8171c56-5fc4-41a0-93d2-0ba410655c1e req-30bb0054-6845-4183-b4c7-134c2ee5ff4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd7bdba-2bb2-4f07-91d6-259c3af250e8", "tag": "e4be0638-9439-4862-aa49-a64acec3c3ee"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:12.826065 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-d8171c56-5fc4-41a0-93d2-0ba410655c1e req-30bb0054-6845-4183-b4c7-134c2ee5ff4b service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:12.826745 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-d8171c56-5fc4-41a0-93d2-0ba410655c1e req-30bb0054-6845-4183-b4c7-134c2ee5ff4b service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:12.827231 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-d8171c56-5fc4-41a0-93d2-0ba410655c1e req-30bb0054-6845-4183-b4c7-134c2ee5ff4b service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:12.838811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-d8171c56-5fc4-41a0-93d2-0ba410655c1e req-30bb0054-6845-4183-b4c7-134c2ee5ff4b service nova] Creating event network-changed:e4be0638-9439-4862-aa49-a64acec3c3ee for instance 8cd7bdba-2bb2-4f07-91d6-259c3af250e8 on hv-cinder-85694 Sep 13 07:04:12.844029 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-d8171c56-5fc4-41a0-93d2-0ba410655c1e req-30bb0054-6845-4183-b4c7-134c2ee5ff4b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035498 Sep 13 07:04:12.844650 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 205/440] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:04:12.898321 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6566e4ad-0b5c-49ff-b942-3173d535f49f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:12.898914 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6566e4ad-0b5c-49ff-b942-3173d535f49f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:12.917754 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6566e4ad-0b5c-49ff-b942-3173d535f49f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:12.918355 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6566e4ad-0b5c-49ff-b942-3173d535f49f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:12.919018 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6566e4ad-0b5c-49ff-b942-3173d535f49f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:12.919828 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6566e4ad-0b5c-49ff-b942-3173d535f49f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:12.920348 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6566e4ad-0b5c-49ff-b942-3173d535f49f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:12.923792 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6566e4ad-0b5c-49ff-b942-3173d535f49f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:12.935369 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-268560d2-bdcd-44f6-b99f-23864b5f04ae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:12.936649 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-268560d2-bdcd-44f6-b99f-23864b5f04ae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:12.945661 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-268560d2-bdcd-44f6-b99f-23864b5f04ae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:12.946528 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-268560d2-bdcd-44f6-b99f-23864b5f04ae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:12.947235 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-268560d2-bdcd-44f6-b99f-23864b5f04ae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:12.949207 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-268560d2-bdcd-44f6-b99f-23864b5f04ae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:12.949878 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-268560d2-bdcd-44f6-b99f-23864b5f04ae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:12.950888 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-268560d2-bdcd-44f6-b99f-23864b5f04ae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:12.993756 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-268560d2-bdcd-44f6-b99f-23864b5f04ae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:12.995958 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-268560d2-bdcd-44f6-b99f-23864b5f04ae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:12.996609 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-268560d2-bdcd-44f6-b99f-23864b5f04ae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:12.997635 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-268560d2-bdcd-44f6-b99f-23864b5f04ae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lazy-loading 'fault' on Instance uuid 67e34c0a-348c-45fc-bbf9-d62e9444353d {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:04:13.070911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-268560d2-bdcd-44f6-b99f-23864b5f04ae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:13.080664 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-268560d2-bdcd-44f6-b99f-23864b5f04ae tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1304 microversion: 2.1 time: 0.151407 Sep 13 07:04:13.102181 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 206/441] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:12 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1304 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:13.210752 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6566e4ad-0b5c-49ff-b942-3173d535f49f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:13.222108 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6566e4ad-0b5c-49ff-b942-3173d535f49f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:13.223896 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6566e4ad-0b5c-49ff-b942-3173d535f49f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:13.225297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6566e4ad-0b5c-49ff-b942-3173d535f49f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1752 microversion: 2.20 time: 0.331851 Sep 13 07:04:13.226630 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 236/442] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:12 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1752 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:14.111535 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3a8727ab-7d4c-408b-b22e-93bc553c6793 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:14.112235 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3a8727ab-7d4c-408b-b22e-93bc553c6793 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:14.119226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a8727ab-7d4c-408b-b22e-93bc553c6793 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:14.119958 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a8727ab-7d4c-408b-b22e-93bc553c6793 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:14.120393 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a8727ab-7d4c-408b-b22e-93bc553c6793 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:14.121105 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a8727ab-7d4c-408b-b22e-93bc553c6793 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:14.121560 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a8727ab-7d4c-408b-b22e-93bc553c6793 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:14.121978 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a8727ab-7d4c-408b-b22e-93bc553c6793 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:14.160856 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dcd26b26-a3e0-40fe-bb67-5d222b80be29 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1409586712"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:14.161513 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-dcd26b26-a3e0-40fe-bb67-5d222b80be29 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:14.162666 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a8727ab-7d4c-408b-b22e-93bc553c6793 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:14.163299 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a8727ab-7d4c-408b-b22e-93bc553c6793 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:14.163596 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a8727ab-7d4c-408b-b22e-93bc553c6793 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:14.164032 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-3a8727ab-7d4c-408b-b22e-93bc553c6793 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lazy-loading 'fault' on Instance uuid 67e34c0a-348c-45fc-bbf9-d62e9444353d {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:04:14.169360 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dcd26b26-a3e0-40fe-bb67-5d222b80be29 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:14.169954 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dcd26b26-a3e0-40fe-bb67-5d222b80be29 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:14.170598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dcd26b26-a3e0-40fe-bb67-5d222b80be29 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:14.171497 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dcd26b26-a3e0-40fe-bb67-5d222b80be29 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:14.172011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dcd26b26-a3e0-40fe-bb67-5d222b80be29 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:14.172485 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dcd26b26-a3e0-40fe-bb67-5d222b80be29 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:14.207976 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3a8727ab-7d4c-408b-b22e-93bc553c6793 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:14.216167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3a8727ab-7d4c-408b-b22e-93bc553c6793 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1304 microversion: 2.1 time: 0.110498 Sep 13 07:04:14.216755 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 207/443] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:14 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:14.252266 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4dead7ad-0eb6-4f99-8a0a-886b911a05c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:14.252880 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4dead7ad-0eb6-4f99-8a0a-886b911a05c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:14.259626 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4dead7ad-0eb6-4f99-8a0a-886b911a05c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:14.260181 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4dead7ad-0eb6-4f99-8a0a-886b911a05c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:14.260626 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4dead7ad-0eb6-4f99-8a0a-886b911a05c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:14.261311 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4dead7ad-0eb6-4f99-8a0a-886b911a05c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:14.261763 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4dead7ad-0eb6-4f99-8a0a-886b911a05c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:14.262230 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4dead7ad-0eb6-4f99-8a0a-886b911a05c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:14.358725 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.network.security_group_api [None req-dcd26b26-a3e0-40fe-bb67-5d222b80be29 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Adding security group 6df806b8-7689-403f-a1d7-a87499a7b12a to port 1e7460cd-303f-44c8-b234-3c2f83c1e238 Sep 13 07:04:14.486274 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4dead7ad-0eb6-4f99-8a0a-886b911a05c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:14.495467 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4dead7ad-0eb6-4f99-8a0a-886b911a05c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:14.496915 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4dead7ad-0eb6-4f99-8a0a-886b911a05c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:14.498110 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4dead7ad-0eb6-4f99-8a0a-886b911a05c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1752 microversion: 2.20 time: 0.250314 Sep 13 07:04:14.498876 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 208/444] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:14 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1752 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:04:14.735876 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dcd26b26-a3e0-40fe-bb67-5d222b80be29 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "POST /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015/action" status: 202 len: 0 microversion: 2.1 time: 0.578894 Sep 13 07:04:14.736478 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 237/445] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Sep 13 07:04:14 2022] POST /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:04:14.744788 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-23c246a2-7254-47f6-96a4-baf5a0e9e93d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:14.745442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-23c246a2-7254-47f6-96a4-baf5a0e9e93d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:14.751555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23c246a2-7254-47f6-96a4-baf5a0e9e93d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:14.752034 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23c246a2-7254-47f6-96a4-baf5a0e9e93d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:14.752462 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23c246a2-7254-47f6-96a4-baf5a0e9e93d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:14.753149 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23c246a2-7254-47f6-96a4-baf5a0e9e93d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:14.753594 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23c246a2-7254-47f6-96a4-baf5a0e9e93d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:14.754008 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23c246a2-7254-47f6-96a4-baf5a0e9e93d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:14.768642 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-3bd7e466-aba8-48c8-805a-3fb01be93a14 req-e40f204e-5b08-4431-a1e7-efe089b8a029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64680760-9370-4f3b-acc5-0ed7d1796015", "tag": "1e7460cd-303f-44c8-b234-3c2f83c1e238"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:14.779837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3bd7e466-aba8-48c8-805a-3fb01be93a14 req-e40f204e-5b08-4431-a1e7-efe089b8a029 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:14.780417 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3bd7e466-aba8-48c8-805a-3fb01be93a14 req-e40f204e-5b08-4431-a1e7-efe089b8a029 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:14.780911 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3bd7e466-aba8-48c8-805a-3fb01be93a14 req-e40f204e-5b08-4431-a1e7-efe089b8a029 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:14.793140 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-3bd7e466-aba8-48c8-805a-3fb01be93a14 req-e40f204e-5b08-4431-a1e7-efe089b8a029 service nova] Creating event network-changed:1e7460cd-303f-44c8-b234-3c2f83c1e238 for instance 64680760-9370-4f3b-acc5-0ed7d1796015 on hv-cinder-85694 Sep 13 07:04:14.798419 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-3bd7e466-aba8-48c8-805a-3fb01be93a14 req-e40f204e-5b08-4431-a1e7-efe089b8a029 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033319 Sep 13 07:04:14.799437 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 238/446] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:04:14.860644 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-e431d346-cefb-48de-a7cf-d0726df86083 req-2262ebaa-20ef-45bd-9e4e-c8595e6dbfe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64680760-9370-4f3b-acc5-0ed7d1796015", "tag": "1e7460cd-303f-44c8-b234-3c2f83c1e238"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:14.870839 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e431d346-cefb-48de-a7cf-d0726df86083 req-2262ebaa-20ef-45bd-9e4e-c8595e6dbfe1 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:14.871601 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e431d346-cefb-48de-a7cf-d0726df86083 req-2262ebaa-20ef-45bd-9e4e-c8595e6dbfe1 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:14.872025 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e431d346-cefb-48de-a7cf-d0726df86083 req-2262ebaa-20ef-45bd-9e4e-c8595e6dbfe1 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:14.884561 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-e431d346-cefb-48de-a7cf-d0726df86083 req-2262ebaa-20ef-45bd-9e4e-c8595e6dbfe1 service nova] Creating event network-changed:1e7460cd-303f-44c8-b234-3c2f83c1e238 for instance 64680760-9370-4f3b-acc5-0ed7d1796015 on hv-cinder-85694 Sep 13 07:04:14.889870 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-e431d346-cefb-48de-a7cf-d0726df86083 req-2262ebaa-20ef-45bd-9e4e-c8595e6dbfe1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033274 Sep 13 07:04:14.890515 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 239/447] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:04:14.924265 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-23c246a2-7254-47f6-96a4-baf5a0e9e93d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:14.933360 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-23c246a2-7254-47f6-96a4-baf5a0e9e93d tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1639 microversion: 2.1 time: 0.192519 Sep 13 07:04:14.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 209/448] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:14 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1639 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:15.240216 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-850024f5-7f61-45e2-86b3-2a9a95cdaa6b tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:15.240904 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-850024f5-7f61-45e2-86b3-2a9a95cdaa6b tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:15.247239 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-850024f5-7f61-45e2-86b3-2a9a95cdaa6b tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:15.247714 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-850024f5-7f61-45e2-86b3-2a9a95cdaa6b tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:15.248135 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-850024f5-7f61-45e2-86b3-2a9a95cdaa6b tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:15.248822 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-850024f5-7f61-45e2-86b3-2a9a95cdaa6b tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:15.249267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-850024f5-7f61-45e2-86b3-2a9a95cdaa6b tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:15.249716 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-850024f5-7f61-45e2-86b3-2a9a95cdaa6b tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:15.283233 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-850024f5-7f61-45e2-86b3-2a9a95cdaa6b tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:15.283972 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-850024f5-7f61-45e2-86b3-2a9a95cdaa6b tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:15.284394 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-850024f5-7f61-45e2-86b3-2a9a95cdaa6b tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:15.284827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-850024f5-7f61-45e2-86b3-2a9a95cdaa6b tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lazy-loading 'fault' on Instance uuid 67e34c0a-348c-45fc-bbf9-d62e9444353d {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:04:15.334278 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-850024f5-7f61-45e2-86b3-2a9a95cdaa6b tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e0774e048684f6b8f79ee44f1c4ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5006f7a1770f4d9a96cbec0715987237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:15.343045 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-850024f5-7f61-45e2-86b3-2a9a95cdaa6b tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 200 len: 1304 microversion: 2.1 time: 0.107581 Sep 13 07:04:15.343606 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 240/449] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:15 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:15.524909 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-542ffbb4-d5ee-4241-a94b-ed90f92af57d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:15.526124 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-542ffbb4-d5ee-4241-a94b-ed90f92af57d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:15.534915 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-542ffbb4-d5ee-4241-a94b-ed90f92af57d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:15.535839 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-542ffbb4-d5ee-4241-a94b-ed90f92af57d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:15.536499 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-542ffbb4-d5ee-4241-a94b-ed90f92af57d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:15.537646 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-542ffbb4-d5ee-4241-a94b-ed90f92af57d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:15.538454 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-542ffbb4-d5ee-4241-a94b-ed90f92af57d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:15.539078 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-542ffbb4-d5ee-4241-a94b-ed90f92af57d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:15.566378 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=100 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:15.801531 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-542ffbb4-d5ee-4241-a94b-ed90f92af57d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:15.819260 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-542ffbb4-d5ee-4241-a94b-ed90f92af57d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:15.820697 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-542ffbb4-d5ee-4241-a94b-ed90f92af57d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:15.821910 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-542ffbb4-d5ee-4241-a94b-ed90f92af57d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1752 microversion: 2.20 time: 0.301215 Sep 13 07:04:15.822528 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 210/450] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:15 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1752 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:16.365858 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-257c0d2f-ec56-4951-bf75-61e01049fa60 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:16.366504 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-257c0d2f-ec56-4951-bf75-61e01049fa60 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] [instance: 67e34c0a-348c-45fc-bbf9-d62e9444353d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:16.373298 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-257c0d2f-ec56-4951-bf75-61e01049fa60 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:16.373782 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-257c0d2f-ec56-4951-bf75-61e01049fa60 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:16.374263 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-257c0d2f-ec56-4951-bf75-61e01049fa60 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:16.374992 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-257c0d2f-ec56-4951-bf75-61e01049fa60 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:16.375442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-257c0d2f-ec56-4951-bf75-61e01049fa60 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:16.375861 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-257c0d2f-ec56-4951-bf75-61e01049fa60 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:16.389911 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-257c0d2f-ec56-4951-bf75-61e01049fa60 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] HTTP exception thrown: Instance 67e34c0a-348c-45fc-bbf9-d62e9444353d could not be found. Sep 13 07:04:16.391881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-257c0d2f-ec56-4951-bf75-61e01049fa60 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Request method failure captured: Sep 13 07:04:16.391881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d HTTP/1.1 Sep 13 07:04:16.391881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:04:16.391881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:04:16.391881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:04:16.391881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:04:16.391881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:04:16.391881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:04:16.391881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:04:16.391881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:04:16.391881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICtHYcAaIdwJWQL9DGuOkVw1pm-4BJNCRm8MR9pE3l7H-Yc7XqDorLCZd1FyNyK4LNeb-ZMN8J6vmYzWzo5qLtBg4XLB-M_bJrzSZmf-puVkb6xMrhYJIaqpIQz8BSt4GozVgmpwbzGWdt5TjXprn9Z8sI7TkfH3mjH0znEbF55Yfps Sep 13 07:04:16.391881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:04:16.391881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:04:16.391881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:04:16.391881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:04:16.391881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:04:16.391881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:04:16.391881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 5006f7a1770f4d9a96cbec0715987237 Sep 13 07:04:16.391881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-VolumesNegativeTest-192172033 Sep 13 07:04:16.391881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:04:16.391881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:04:16.393476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5006f7a1770f4d9a96cbec0715987237"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5006f7a1770f4d9a96cbec0715987237"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5006f7a1770f4d9a96cbec0715987237"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5006f7a1770f4d9a96cbec0715987237", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:04:16.393476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-VolumesNegativeTest-192172033 Sep 13 07:04:16.393476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 5006f7a1770f4d9a96cbec0715987237 Sep 13 07:04:16.393476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-VolumesNegativeTest-192172033 Sep 13 07:04:16.393476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-VolumesNegativeTest-192172033-project Sep 13 07:04:16.393476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:04:16.393476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:04:16.393476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 7e0774e048684f6b8f79ee44f1c4ff7c Sep 13 07:04:16.393476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-VolumesNegativeTest-192172033-project Sep 13 07:04:16.393476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:04:16.393476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance 67e34c0a-348c-45fc-bbf9-d62e9444353d could not be found. Sep 13 07:04:16.393476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': '67e34c0a-348c-45fc-bbf9-d62e9444353d'} Sep 13 07:04:16.394487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:04:16.394487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:04:16.394487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:04:16.394487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:04:16.394487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:04:16.394487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:04:16.394487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:04:16.394487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:04:16.394487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:04:16.394487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:04:16.394487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67e34c0a-348c-45fc-bbf9-d62e9444353d could not be found. Sep 13 07:04:16.394487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:04:16.394487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:04:16.394487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:04:16.394487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:04:16.394487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:04:16.394487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:04:16.394487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:04:16.394487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:04:16.394487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:04:16.395905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:04:16.395905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:04:16.395905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:04:16.395905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:04:16.395905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:04:16.395905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:04:16.395905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:04:16.395905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67e34c0a-348c-45fc-bbf9-d62e9444353d could not be found. Sep 13 07:04:16.395905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:04:16.395905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:04:16.395905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:04:16.395905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:04:16.395905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:04:16.395905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:04:16.395905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:04:16.395905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:04:16.395905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67e34c0a-348c-45fc-bbf9-d62e9444353d could not be found. Sep 13 07:04:16.395905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:04:16.397110 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-257c0d2f-ec56-4951-bf75-61e01049fa60 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] Returning 404 to user: Instance 67e34c0a-348c-45fc-bbf9-d62e9444353d could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:04:16.397110 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-257c0d2f-ec56-4951-bf75-61e01049fa60 tempest-VolumesNegativeTest-192172033 tempest-VolumesNegativeTest-192172033-project] 10.222.0.25 "GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d" status: 404 len: 111 microversion: 2.1 time: 0.031512 Sep 13 07:04:16.403552 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 241/451] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:16 2022] GET /compute/v2.1/servers/67e34c0a-348c-45fc-bbf9-d62e9444353d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:04:16.878269 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4372f5ac-d8c4-4067-b067-988a1bbeda87 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:16.879791 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4372f5ac-d8c4-4067-b067-988a1bbeda87 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:16.920844 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4372f5ac-d8c4-4067-b067-988a1bbeda87 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:16.932243 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4372f5ac-d8c4-4067-b067-988a1bbeda87 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:16.933309 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4372f5ac-d8c4-4067-b067-988a1bbeda87 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:16.935206 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4372f5ac-d8c4-4067-b067-988a1bbeda87 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:16.936208 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4372f5ac-d8c4-4067-b067-988a1bbeda87 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:16.937471 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4372f5ac-d8c4-4067-b067-988a1bbeda87 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:17.360930 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4372f5ac-d8c4-4067-b067-988a1bbeda87 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:17.386785 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4372f5ac-d8c4-4067-b067-988a1bbeda87 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:17.388525 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4372f5ac-d8c4-4067-b067-988a1bbeda87 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:17.389759 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4372f5ac-d8c4-4067-b067-988a1bbeda87 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1752 microversion: 2.20 time: 0.543753 Sep 13 07:04:17.392556 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 211/452] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:16 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1752 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:18.428996 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d1827eed-f897-48bd-b646-10a008162c58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:18.429916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d1827eed-f897-48bd-b646-10a008162c58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:18.437940 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d1827eed-f897-48bd-b646-10a008162c58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:18.438739 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d1827eed-f897-48bd-b646-10a008162c58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:18.439264 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d1827eed-f897-48bd-b646-10a008162c58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:18.440249 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d1827eed-f897-48bd-b646-10a008162c58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:18.440822 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d1827eed-f897-48bd-b646-10a008162c58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:18.441467 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d1827eed-f897-48bd-b646-10a008162c58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:18.584742 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d1827eed-f897-48bd-b646-10a008162c58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:18.600814 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d1827eed-f897-48bd-b646-10a008162c58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:18.602404 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d1827eed-f897-48bd-b646-10a008162c58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:18.604303 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d1827eed-f897-48bd-b646-10a008162c58 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1808 microversion: 2.20 time: 0.179249 Sep 13 07:04:18.609995 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 242/453] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:18 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:19.640853 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2f0ee97f-d81d-4dde-9e14-50100810de31 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:19.641588 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2f0ee97f-d81d-4dde-9e14-50100810de31 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:19.648640 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2f0ee97f-d81d-4dde-9e14-50100810de31 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:19.649312 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2f0ee97f-d81d-4dde-9e14-50100810de31 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:19.649746 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2f0ee97f-d81d-4dde-9e14-50100810de31 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:19.650571 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2f0ee97f-d81d-4dde-9e14-50100810de31 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:19.651114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2f0ee97f-d81d-4dde-9e14-50100810de31 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:19.651543 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2f0ee97f-d81d-4dde-9e14-50100810de31 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:19.811500 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2f0ee97f-d81d-4dde-9e14-50100810de31 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:19.820902 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2f0ee97f-d81d-4dde-9e14-50100810de31 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:19.824866 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2f0ee97f-d81d-4dde-9e14-50100810de31 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:19.826158 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2f0ee97f-d81d-4dde-9e14-50100810de31 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1808 microversion: 2.20 time: 0.189908 Sep 13 07:04:19.827097 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 212/454] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:19 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:20.851169 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2ce0a188-95a4-4711-aa59-981ebdf0ae62 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:20.851808 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2ce0a188-95a4-4711-aa59-981ebdf0ae62 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:20.859387 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2ce0a188-95a4-4711-aa59-981ebdf0ae62 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:20.859862 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2ce0a188-95a4-4711-aa59-981ebdf0ae62 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:20.860283 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2ce0a188-95a4-4711-aa59-981ebdf0ae62 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:20.860958 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2ce0a188-95a4-4711-aa59-981ebdf0ae62 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:20.861394 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2ce0a188-95a4-4711-aa59-981ebdf0ae62 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:20.861803 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2ce0a188-95a4-4711-aa59-981ebdf0ae62 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:21.008142 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2ce0a188-95a4-4711-aa59-981ebdf0ae62 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:21.018277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2ce0a188-95a4-4711-aa59-981ebdf0ae62 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:21.019817 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2ce0a188-95a4-4711-aa59-981ebdf0ae62 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:21.021205 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2ce0a188-95a4-4711-aa59-981ebdf0ae62 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1808 microversion: 2.20 time: 0.174101 Sep 13 07:04:21.021870 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 243/455] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:20 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:04:22.049761 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c20f83b6-891e-48a0-bf6e-18e67573273d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:22.054695 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c20f83b6-891e-48a0-bf6e-18e67573273d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:22.077006 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c20f83b6-891e-48a0-bf6e-18e67573273d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:22.077502 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c20f83b6-891e-48a0-bf6e-18e67573273d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:22.077927 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c20f83b6-891e-48a0-bf6e-18e67573273d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:22.078669 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c20f83b6-891e-48a0-bf6e-18e67573273d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:22.079287 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c20f83b6-891e-48a0-bf6e-18e67573273d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:22.079706 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c20f83b6-891e-48a0-bf6e-18e67573273d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:22.245078 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c20f83b6-891e-48a0-bf6e-18e67573273d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:22.258614 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c20f83b6-891e-48a0-bf6e-18e67573273d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:22.260921 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c20f83b6-891e-48a0-bf6e-18e67573273d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:22.263012 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c20f83b6-891e-48a0-bf6e-18e67573273d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1808 microversion: 2.20 time: 0.217406 Sep 13 07:04:22.264361 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 213/456] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:22 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:23.292318 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-83ca4ab6-8b0a-4485-b51a-ec7b5c95d265 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:23.294098 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-83ca4ab6-8b0a-4485-b51a-ec7b5c95d265 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:23.305305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83ca4ab6-8b0a-4485-b51a-ec7b5c95d265 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:23.306615 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83ca4ab6-8b0a-4485-b51a-ec7b5c95d265 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:23.307390 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83ca4ab6-8b0a-4485-b51a-ec7b5c95d265 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:23.308302 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83ca4ab6-8b0a-4485-b51a-ec7b5c95d265 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:23.308919 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83ca4ab6-8b0a-4485-b51a-ec7b5c95d265 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:23.309724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83ca4ab6-8b0a-4485-b51a-ec7b5c95d265 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:23.578774 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-83ca4ab6-8b0a-4485-b51a-ec7b5c95d265 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:23.588317 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-83ca4ab6-8b0a-4485-b51a-ec7b5c95d265 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:23.589773 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-83ca4ab6-8b0a-4485-b51a-ec7b5c95d265 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:23.590994 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-83ca4ab6-8b0a-4485-b51a-ec7b5c95d265 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1808 microversion: 2.20 time: 0.305757 Sep 13 07:04:23.598427 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 244/457] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:23 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1808 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:23.610154 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f2221c6e-4487-439f-8743-7f938a5f51db tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1648685772", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1849819186", "security_groups": [{"name": "tempest-secgroup-smoke-117343608"}], "networks": [{"uuid": "027dc9b9-4576-4664-afcd-fda58e74e1bc"}], "block_device_mapping_v2": [{"uuid": "2ad7eb27-f11f-49e3-a40f-8d74dbace726", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:23.759254 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-f2221c6e-4487-439f-8743-7f938a5f51db tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] validate_networks() for [('027dc9b9-4576-4664-afcd-fda58e74e1bc', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:04:24.261460 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-f2221c6e-4487-439f-8743-7f938a5f51db tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:04:24.261944 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-f2221c6e-4487-439f-8743-7f938a5f51db tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:04:24.262498 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-f2221c6e-4487-439f-8743-7f938a5f51db tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:04:24.262946 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-f2221c6e-4487-439f-8743-7f938a5f51db tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:04:24.263701 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-f2221c6e-4487-439f-8743-7f938a5f51db tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:04:24.274970 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f2221c6e-4487-439f-8743-7f938a5f51db tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:24.275832 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f2221c6e-4487-439f-8743-7f938a5f51db tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:24.277124 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f2221c6e-4487-439f-8743-7f938a5f51db tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:24.277903 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f2221c6e-4487-439f-8743-7f938a5f51db tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:24.278401 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f2221c6e-4487-439f-8743-7f938a5f51db tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:24.278799 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f2221c6e-4487-439f-8743-7f938a5f51db tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:24.297841 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-f2221c6e-4487-439f-8743-7f938a5f51db tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Getting quotas for project 8e08bdf8d28f4a5093df2c5b26ccb9e6. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:04:24.302862 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-f2221c6e-4487-439f-8743-7f938a5f51db tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Getting quotas for user a04d90d3f1e04a00b2ace1893ce5ef71 and project 8e08bdf8d28f4a5093df2c5b26ccb9e6. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:04:24.399148 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f2221c6e-4487-439f-8743-7f938a5f51db tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:04:24.402712 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f2221c6e-4487-439f-8743-7f938a5f51db tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2ad7eb27-f11f-49e3-a40f-8d74dbace726',volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:04:24.572651 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f2221c6e-4487-439f-8743-7f938a5f51db tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.972577 Sep 13 07:04:24.573969 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 214/458] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Sep 13 07:04:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 07:04:24.586064 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c3821c5a-99be-4425-8d75-b592effc720f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:24.587875 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c3821c5a-99be-4425-8d75-b592effc720f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:24.625663 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-278491c9-0c21-46be-b948-03978399c289 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:24.631038 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-278491c9-0c21-46be-b948-03978399c289 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:24.646167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-278491c9-0c21-46be-b948-03978399c289 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:24.647540 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-278491c9-0c21-46be-b948-03978399c289 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:24.648923 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-278491c9-0c21-46be-b948-03978399c289 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:24.652769 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-278491c9-0c21-46be-b948-03978399c289 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:24.653879 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-278491c9-0c21-46be-b948-03978399c289 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:24.654978 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-278491c9-0c21-46be-b948-03978399c289 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:24.729633 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c3821c5a-99be-4425-8d75-b592effc720f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:24.744701 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c3821c5a-99be-4425-8d75-b592effc720f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1089 microversion: 2.1 time: 0.157506 Sep 13 07:04:24.746051 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 245/459] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:24 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1089 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:24.891160 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-278491c9-0c21-46be-b948-03978399c289 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:24.902304 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-278491c9-0c21-46be-b948-03978399c289 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:24.904386 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-278491c9-0c21-46be-b948-03978399c289 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:24.905594 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-278491c9-0c21-46be-b948-03978399c289 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1808 microversion: 2.20 time: 0.292250 Sep 13 07:04:24.917129 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 215/460] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:24 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1808 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:25.775477 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f439ffb7-2230-4184-aa6a-eeb85e6dcddd tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:25.777124 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f439ffb7-2230-4184-aa6a-eeb85e6dcddd tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:25.798462 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f439ffb7-2230-4184-aa6a-eeb85e6dcddd tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:25.799554 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f439ffb7-2230-4184-aa6a-eeb85e6dcddd tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:25.803068 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f439ffb7-2230-4184-aa6a-eeb85e6dcddd tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:25.804256 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f439ffb7-2230-4184-aa6a-eeb85e6dcddd tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:25.805431 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f439ffb7-2230-4184-aa6a-eeb85e6dcddd tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:25.808244 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f439ffb7-2230-4184-aa6a-eeb85e6dcddd tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:25.895991 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f439ffb7-2230-4184-aa6a-eeb85e6dcddd tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:25.919538 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f439ffb7-2230-4184-aa6a-eeb85e6dcddd tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1139 microversion: 2.1 time: 0.147988 Sep 13 07:04:25.934741 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 246/461] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:25 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1139 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:25.938785 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-93835fa4-29e4-4c21-9211-008c6ff93973 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:25.940111 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-93835fa4-29e4-4c21-9211-008c6ff93973 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:25.956152 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-93835fa4-29e4-4c21-9211-008c6ff93973 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:25.956724 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-93835fa4-29e4-4c21-9211-008c6ff93973 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:25.957225 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-93835fa4-29e4-4c21-9211-008c6ff93973 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:25.957974 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-93835fa4-29e4-4c21-9211-008c6ff93973 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:25.958552 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-93835fa4-29e4-4c21-9211-008c6ff93973 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:25.959009 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-93835fa4-29e4-4c21-9211-008c6ff93973 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:26.229884 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-93835fa4-29e4-4c21-9211-008c6ff93973 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:26.240320 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-93835fa4-29e4-4c21-9211-008c6ff93973 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:26.244425 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-93835fa4-29e4-4c21-9211-008c6ff93973 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:26.252660 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-93835fa4-29e4-4c21-9211-008c6ff93973 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1808 microversion: 2.20 time: 0.323255 Sep 13 07:04:26.254655 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 216/462] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:25 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1808 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:26.947740 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b4b8bf92-ca5e-4cbf-b474-0da9946bc8b6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:26.948531 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b4b8bf92-ca5e-4cbf-b474-0da9946bc8b6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:26.962228 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b4b8bf92-ca5e-4cbf-b474-0da9946bc8b6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:26.962855 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b4b8bf92-ca5e-4cbf-b474-0da9946bc8b6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:26.963495 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b4b8bf92-ca5e-4cbf-b474-0da9946bc8b6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:26.964371 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b4b8bf92-ca5e-4cbf-b474-0da9946bc8b6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:26.964974 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b4b8bf92-ca5e-4cbf-b474-0da9946bc8b6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:26.965548 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b4b8bf92-ca5e-4cbf-b474-0da9946bc8b6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:27.039998 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b4b8bf92-ca5e-4cbf-b474-0da9946bc8b6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:27.050862 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b4b8bf92-ca5e-4cbf-b474-0da9946bc8b6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1139 microversion: 2.1 time: 0.107052 Sep 13 07:04:27.072980 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 247/463] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:26 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1139 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:27.281030 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-41ea0d55-ddea-439c-b336-a0b5163fb63f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:27.281689 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-41ea0d55-ddea-439c-b336-a0b5163fb63f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:27.294830 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-41ea0d55-ddea-439c-b336-a0b5163fb63f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:27.295661 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-41ea0d55-ddea-439c-b336-a0b5163fb63f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:27.296254 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-41ea0d55-ddea-439c-b336-a0b5163fb63f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:27.297316 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-41ea0d55-ddea-439c-b336-a0b5163fb63f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:27.297918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-41ea0d55-ddea-439c-b336-a0b5163fb63f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:27.298740 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-41ea0d55-ddea-439c-b336-a0b5163fb63f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:27.493004 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-41ea0d55-ddea-439c-b336-a0b5163fb63f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:27.503628 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-41ea0d55-ddea-439c-b336-a0b5163fb63f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:27.505372 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-41ea0d55-ddea-439c-b336-a0b5163fb63f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:27.506801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-41ea0d55-ddea-439c-b336-a0b5163fb63f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1808 microversion: 2.20 time: 0.229815 Sep 13 07:04:27.507546 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 217/464] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:27 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:04:28.080867 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-99f68f0b-4092-43dc-a6b6-0395e67e885e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:28.081368 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-99f68f0b-4092-43dc-a6b6-0395e67e885e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:28.083814 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:28.090473 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-99f68f0b-4092-43dc-a6b6-0395e67e885e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:28.091325 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-99f68f0b-4092-43dc-a6b6-0395e67e885e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:28.091964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-99f68f0b-4092-43dc-a6b6-0395e67e885e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:28.092910 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-99f68f0b-4092-43dc-a6b6-0395e67e885e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:28.094007 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-99f68f0b-4092-43dc-a6b6-0395e67e885e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:28.094681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-99f68f0b-4092-43dc-a6b6-0395e67e885e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:28.161212 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-99f68f0b-4092-43dc-a6b6-0395e67e885e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:28.170475 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-99f68f0b-4092-43dc-a6b6-0395e67e885e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1139 microversion: 2.1 time: 0.094151 Sep 13 07:04:28.171553 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 248/465] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:28 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1139 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:28.536903 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-77f8894b-22b3-41d6-8143-d3af48dfea8e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:28.538201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-77f8894b-22b3-41d6-8143-d3af48dfea8e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:28.547086 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-77f8894b-22b3-41d6-8143-d3af48dfea8e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:28.547912 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-77f8894b-22b3-41d6-8143-d3af48dfea8e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:28.548537 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-77f8894b-22b3-41d6-8143-d3af48dfea8e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:28.549457 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-77f8894b-22b3-41d6-8143-d3af48dfea8e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:28.550696 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-77f8894b-22b3-41d6-8143-d3af48dfea8e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:28.551350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-77f8894b-22b3-41d6-8143-d3af48dfea8e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:28.726647 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-77f8894b-22b3-41d6-8143-d3af48dfea8e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:28.738734 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-77f8894b-22b3-41d6-8143-d3af48dfea8e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:28.741056 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-77f8894b-22b3-41d6-8143-d3af48dfea8e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:28.742433 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-77f8894b-22b3-41d6-8143-d3af48dfea8e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1808 microversion: 2.20 time: 0.210503 Sep 13 07:04:28.743782 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 218/466] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:28 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:29.201695 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-80a71a45-23ae-4a49-a9ee-f5c923393f34 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:29.202986 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-80a71a45-23ae-4a49-a9ee-f5c923393f34 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:29.210034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-80a71a45-23ae-4a49-a9ee-f5c923393f34 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:29.210760 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-80a71a45-23ae-4a49-a9ee-f5c923393f34 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:29.211373 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-80a71a45-23ae-4a49-a9ee-f5c923393f34 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:29.212462 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-80a71a45-23ae-4a49-a9ee-f5c923393f34 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:29.213125 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-80a71a45-23ae-4a49-a9ee-f5c923393f34 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:29.214038 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-80a71a45-23ae-4a49-a9ee-f5c923393f34 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:29.290514 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-80a71a45-23ae-4a49-a9ee-f5c923393f34 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:29.298592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-80a71a45-23ae-4a49-a9ee-f5c923393f34 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1139 microversion: 2.1 time: 0.105387 Sep 13 07:04:29.299791 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 249/467] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:29 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1139 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:29.768762 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c7a968f7-e711-41fd-9780-5acb00026fec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:29.770068 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c7a968f7-e711-41fd-9780-5acb00026fec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:29.779130 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7a968f7-e711-41fd-9780-5acb00026fec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:29.779642 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7a968f7-e711-41fd-9780-5acb00026fec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:29.780136 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7a968f7-e711-41fd-9780-5acb00026fec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:29.780797 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7a968f7-e711-41fd-9780-5acb00026fec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:29.781233 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7a968f7-e711-41fd-9780-5acb00026fec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:29.781667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7a968f7-e711-41fd-9780-5acb00026fec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:30.033897 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c7a968f7-e711-41fd-9780-5acb00026fec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:30.052416 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c7a968f7-e711-41fd-9780-5acb00026fec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:30.053985 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c7a968f7-e711-41fd-9780-5acb00026fec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:30.055224 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c7a968f7-e711-41fd-9780-5acb00026fec tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1808 microversion: 2.20 time: 0.290736 Sep 13 07:04:30.056808 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 219/468] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:29 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1808 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:30.323341 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d12c9906-258e-4e04-a1cf-5502c1ecb186 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:30.323954 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d12c9906-258e-4e04-a1cf-5502c1ecb186 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:30.332698 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d12c9906-258e-4e04-a1cf-5502c1ecb186 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:30.332994 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d12c9906-258e-4e04-a1cf-5502c1ecb186 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:30.333406 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d12c9906-258e-4e04-a1cf-5502c1ecb186 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:30.334121 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d12c9906-258e-4e04-a1cf-5502c1ecb186 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:30.334571 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d12c9906-258e-4e04-a1cf-5502c1ecb186 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:30.335013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d12c9906-258e-4e04-a1cf-5502c1ecb186 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:30.420994 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d12c9906-258e-4e04-a1cf-5502c1ecb186 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:30.430232 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d12c9906-258e-4e04-a1cf-5502c1ecb186 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1187 microversion: 2.1 time: 0.111598 Sep 13 07:04:30.431925 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 250/469] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:30 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1187 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:31.085785 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-970f7cd8-ce51-47a9-86d8-601692145ba2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:31.086478 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-970f7cd8-ce51-47a9-86d8-601692145ba2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:31.094245 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-970f7cd8-ce51-47a9-86d8-601692145ba2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:31.094833 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-970f7cd8-ce51-47a9-86d8-601692145ba2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:31.095334 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-970f7cd8-ce51-47a9-86d8-601692145ba2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:31.096428 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-970f7cd8-ce51-47a9-86d8-601692145ba2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:31.097132 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-970f7cd8-ce51-47a9-86d8-601692145ba2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:31.097525 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-970f7cd8-ce51-47a9-86d8-601692145ba2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:31.303115 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-970f7cd8-ce51-47a9-86d8-601692145ba2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:31.329879 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-970f7cd8-ce51-47a9-86d8-601692145ba2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:31.334351 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-970f7cd8-ce51-47a9-86d8-601692145ba2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:31.335730 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-970f7cd8-ce51-47a9-86d8-601692145ba2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1808 microversion: 2.20 time: 0.254489 Sep 13 07:04:31.337076 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 220/470] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:31 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:31.456317 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7af76ee8-058f-44a7-b71c-639efb7977a1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:31.457383 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7af76ee8-058f-44a7-b71c-639efb7977a1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:31.465798 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7af76ee8-058f-44a7-b71c-639efb7977a1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:31.466106 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7af76ee8-058f-44a7-b71c-639efb7977a1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:31.466763 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7af76ee8-058f-44a7-b71c-639efb7977a1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:31.467648 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7af76ee8-058f-44a7-b71c-639efb7977a1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:31.468460 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7af76ee8-058f-44a7-b71c-639efb7977a1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:31.469241 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7af76ee8-058f-44a7-b71c-639efb7977a1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:31.576958 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7af76ee8-058f-44a7-b71c-639efb7977a1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:31.580643 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:31.586481 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7af76ee8-058f-44a7-b71c-639efb7977a1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1205 microversion: 2.1 time: 0.133845 Sep 13 07:04:31.587508 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 251/471] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:31 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1205 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:32.361171 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-445008ee-3bba-4acf-8e71-6195b2df15ea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:32.361688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-445008ee-3bba-4acf-8e71-6195b2df15ea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:32.367703 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:32.369591 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-445008ee-3bba-4acf-8e71-6195b2df15ea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:32.370069 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-445008ee-3bba-4acf-8e71-6195b2df15ea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:32.370554 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-445008ee-3bba-4acf-8e71-6195b2df15ea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:32.371252 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-445008ee-3bba-4acf-8e71-6195b2df15ea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:32.371700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-445008ee-3bba-4acf-8e71-6195b2df15ea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:32.372265 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-445008ee-3bba-4acf-8e71-6195b2df15ea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:32.607841 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-445008ee-3bba-4acf-8e71-6195b2df15ea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:32.613216 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8b4e5fa8-e5c4-4e49-ad73-6a1beea0af93 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:32.613840 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8b4e5fa8-e5c4-4e49-ad73-6a1beea0af93 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:32.633593 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8b4e5fa8-e5c4-4e49-ad73-6a1beea0af93 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:32.634396 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8b4e5fa8-e5c4-4e49-ad73-6a1beea0af93 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:32.634594 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8b4e5fa8-e5c4-4e49-ad73-6a1beea0af93 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:32.639749 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-445008ee-3bba-4acf-8e71-6195b2df15ea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:32.643324 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-445008ee-3bba-4acf-8e71-6195b2df15ea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:32.644617 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8b4e5fa8-e5c4-4e49-ad73-6a1beea0af93 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:32.645100 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8b4e5fa8-e5c4-4e49-ad73-6a1beea0af93 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:32.646395 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-445008ee-3bba-4acf-8e71-6195b2df15ea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1808 microversion: 2.20 time: 0.289399 Sep 13 07:04:32.648577 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8b4e5fa8-e5c4-4e49-ad73-6a1beea0af93 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:32.653352 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 221/472] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:32 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1808 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:32.873979 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8b4e5fa8-e5c4-4e49-ad73-6a1beea0af93 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:32.883238 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8b4e5fa8-e5c4-4e49-ad73-6a1beea0af93 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1260 microversion: 2.1 time: 0.273749 Sep 13 07:04:32.898588 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 252/473] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:32 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1260 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:33.675283 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7d2e2727-69ae-4ea8-b331-b40ec6a74a19 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:33.675954 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7d2e2727-69ae-4ea8-b331-b40ec6a74a19 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:33.683088 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7d2e2727-69ae-4ea8-b331-b40ec6a74a19 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:33.683577 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7d2e2727-69ae-4ea8-b331-b40ec6a74a19 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:33.684007 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7d2e2727-69ae-4ea8-b331-b40ec6a74a19 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:33.684704 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7d2e2727-69ae-4ea8-b331-b40ec6a74a19 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:33.685146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7d2e2727-69ae-4ea8-b331-b40ec6a74a19 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:33.685738 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7d2e2727-69ae-4ea8-b331-b40ec6a74a19 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:33.905832 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-d7cdedc8-9867-4618-b26d-95af247ce046 req-9de140b3-272c-4907-9777-19c3401959e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d695cc83-d3c5-44c9-af4a-2f0e67a96adf", "tag": "a7477596-3b59-40f9-9676-9d56b3b3aba4"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:33.928104 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d7cdedc8-9867-4618-b26d-95af247ce046 req-9de140b3-272c-4907-9777-19c3401959e1 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:33.928667 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d7cdedc8-9867-4618-b26d-95af247ce046 req-9de140b3-272c-4907-9777-19c3401959e1 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:33.929263 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d7cdedc8-9867-4618-b26d-95af247ce046 req-9de140b3-272c-4907-9777-19c3401959e1 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:33.945674 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-d7cdedc8-9867-4618-b26d-95af247ce046 req-9de140b3-272c-4907-9777-19c3401959e1 service nova] Creating event network-changed:a7477596-3b59-40f9-9676-9d56b3b3aba4 for instance d695cc83-d3c5-44c9-af4a-2f0e67a96adf on hv-cinder-85694 Sep 13 07:04:33.970416 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-d7cdedc8-9867-4618-b26d-95af247ce046 req-9de140b3-272c-4907-9777-19c3401959e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070527 Sep 13 07:04:33.971283 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 253/474] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:04:33.981926 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0b21dfb3-e095-4220-81b8-19fb6196acce tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:33.988060 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0b21dfb3-e095-4220-81b8-19fb6196acce tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:33.991105 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7d2e2727-69ae-4ea8-b331-b40ec6a74a19 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:34.002941 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0b21dfb3-e095-4220-81b8-19fb6196acce tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:34.003746 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0b21dfb3-e095-4220-81b8-19fb6196acce tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:34.004342 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0b21dfb3-e095-4220-81b8-19fb6196acce tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:34.006149 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0b21dfb3-e095-4220-81b8-19fb6196acce tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:34.007782 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0b21dfb3-e095-4220-81b8-19fb6196acce tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:34.008357 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0b21dfb3-e095-4220-81b8-19fb6196acce tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:34.010723 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7d2e2727-69ae-4ea8-b331-b40ec6a74a19 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:34.013153 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7d2e2727-69ae-4ea8-b331-b40ec6a74a19 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:34.015311 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7d2e2727-69ae-4ea8-b331-b40ec6a74a19 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1808 microversion: 2.20 time: 0.343962 Sep 13 07:04:34.033607 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 222/475] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:33 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1808 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:04:34.496379 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0b21dfb3-e095-4220-81b8-19fb6196acce tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:34.509567 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0b21dfb3-e095-4220-81b8-19fb6196acce tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1260 microversion: 2.1 time: 0.533167 Sep 13 07:04:34.510219 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 254/476] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:33 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1260 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:34.539793 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-05d1d619-2164-4d1a-bdd0-a6ab4ebf4c02 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:34.540628 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-05d1d619-2164-4d1a-bdd0-a6ab4ebf4c02 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:34.543805 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:34.545393 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=6 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:34.552020 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-05d1d619-2164-4d1a-bdd0-a6ab4ebf4c02 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:34.552768 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-05d1d619-2164-4d1a-bdd0-a6ab4ebf4c02 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:34.553203 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-05d1d619-2164-4d1a-bdd0-a6ab4ebf4c02 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:34.553947 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-05d1d619-2164-4d1a-bdd0-a6ab4ebf4c02 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:34.554430 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-05d1d619-2164-4d1a-bdd0-a6ab4ebf4c02 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:34.554852 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-05d1d619-2164-4d1a-bdd0-a6ab4ebf4c02 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:34.580736 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-05d1d619-2164-4d1a-bdd0-a6ab4ebf4c02 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439/ips" status: 200 len: 149 microversion: 2.1 time: 0.045839 Sep 13 07:04:34.581698 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 223/477] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Sep 13 07:04:34 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:04:34.594502 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-86417c33-7ced-4cb6-8a46-4743e95cb144 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6751156-b7a1-49fc-8c48-aaa808bcdc38"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:34.597192 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-86417c33-7ced-4cb6-8a46-4743e95cb144 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:34.603412 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86417c33-7ced-4cb6-8a46-4743e95cb144 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:34.603994 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86417c33-7ced-4cb6-8a46-4743e95cb144 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:34.604489 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86417c33-7ced-4cb6-8a46-4743e95cb144 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:34.605695 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86417c33-7ced-4cb6-8a46-4743e95cb144 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:34.606360 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86417c33-7ced-4cb6-8a46-4743e95cb144 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:34.606923 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86417c33-7ced-4cb6-8a46-4743e95cb144 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:34.694590 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-86417c33-7ced-4cb6-8a46-4743e95cb144 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] HTTP exception thrown: Invalid volume: volume c6751156-b7a1-49fc-8c48-aaa808bcdc38 is already attached to instances: 98fc8f3f-7357-45fd-b982-ea283b3b33dd Sep 13 07:04:34.696347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-86417c33-7ced-4cb6-8a46-4743e95cb144 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Request method failure captured: Sep 13 07:04:34.696347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: POST /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439/os-volume_attachments HTTP/1.1 Sep 13 07:04:34.696347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:04:34.696347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:04:34.696347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:04:34.696347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 74 Sep 13 07:04:34.696347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:04:34.696347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:04:34.696347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:04:34.696347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:04:34.696347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICqyV8ZDoWvOKN7yB2xTUSeGEw-19LbL5z3b7FCDIrTHuyvYi1pO573AgmLpQMkZe3-u2HyPkAvEThrpkgPF3Y3DpDsAGrmh9FoN2kYrWow6jJnFAoIJGNoEoe53GgBmZUC7q0mN4-e6vnmtsq8cJkNCfkZrjfSjeL4PS70F44wGPd0 Sep 13 07:04:34.696347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:04:34.696347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:04:34.696347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:04:34.696347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:04:34.696347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:04:34.696347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:04:34.696347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:04:34.696347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:04:34.696347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:04:34.696347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:04:34.697797 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8c7dc05c1c9d40b2bb0defc9dd157d6e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:04:34.697797 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:04:34.697797 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:04:34.697797 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:04:34.697797 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:04:34.697797 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:04:34.697797 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:04:34.697797 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 5a0fd7347cad41bc80f427f872cf78fa Sep 13 07:04:34.697797 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:04:34.697797 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Sep 13 07:04:34.697797 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {"volumeAttachment": {"volumeId": "c6751156-b7a1-49fc-8c48-aaa808bcdc38"}} Sep 13 07:04:34.697797 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:04:34.698612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Invalid volume: volume c6751156-b7a1-49fc-8c48-aaa808bcdc38 is already attached to instances: 98fc8f3f-7357-45fd-b982-ea283b3b33dd Sep 13 07:04:34.698612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'server_id': '9e9c0b75-cd49-4a40-bd4c-24ab750fd439', 'body': {'volumeAttachment': {'volumeId': 'c6751156-b7a1-49fc-8c48-aaa808bcdc38'}}} Sep 13 07:04:34.698612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:04:34.698612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:04:34.698612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 07:04:34.698612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 07:04:34.698612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 07:04:34.698612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 07:04:34.698612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 07:04:34.698612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 07:04:34.698612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 07:04:34.698612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 07:04:34.698612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 07:04:34.698612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 07:04:34.698612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c6751156-b7a1-49fc-8c48-aaa808bcdc38 is already attached to instances: 98fc8f3f-7357-45fd-b982-ea283b3b33dd Sep 13 07:04:34.698612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:04:34.698612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:04:34.698612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:04:34.698612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:04:34.699816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:04:34.699816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:04:34.699816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:04:34.699816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:04:34.699816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:04:34.699816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:04:34.699816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 07:04:34.699816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 07:04:34.699816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 07:04:34.699816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 07:04:34.699816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 07:04:34.699816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 07:04:34.699816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 07:04:34.699816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 07:04:34.699816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c6751156-b7a1-49fc-8c48-aaa808bcdc38 is already attached to instances: 98fc8f3f-7357-45fd-b982-ea283b3b33dd Sep 13 07:04:34.699816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:04:34.699816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:04:34.699816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:04:34.699816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:04:34.699816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:04:34.701006 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:04:34.701006 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:04:34.701006 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:04:34.701006 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c6751156-b7a1-49fc-8c48-aaa808bcdc38 is already attached to instances: 98fc8f3f-7357-45fd-b982-ea283b3b33dd Sep 13 07:04:34.701006 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:04:34.702902 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-86417c33-7ced-4cb6-8a46-4743e95cb144 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Returning 400 to user: Invalid volume: volume c6751156-b7a1-49fc-8c48-aaa808bcdc38 is already attached to instances: 98fc8f3f-7357-45fd-b982-ea283b3b33dd {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:04:34.703844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-86417c33-7ced-4cb6-8a46-4743e95cb144 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "POST /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113902 Sep 13 07:04:34.704634 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 255/478] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Sep 13 07:04:34 2022] POST /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 07:04:34.713757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7dc39b6f-37d1-4250-afa7-a59dda59462c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:34.714349 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7dc39b6f-37d1-4250-afa7-a59dda59462c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:34.720746 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7dc39b6f-37d1-4250-afa7-a59dda59462c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:34.721238 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7dc39b6f-37d1-4250-afa7-a59dda59462c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:34.721675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7dc39b6f-37d1-4250-afa7-a59dda59462c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:34.722672 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7dc39b6f-37d1-4250-afa7-a59dda59462c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:34.723348 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7dc39b6f-37d1-4250-afa7-a59dda59462c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:34.723839 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7dc39b6f-37d1-4250-afa7-a59dda59462c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:34.749629 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7dc39b6f-37d1-4250-afa7-a59dda59462c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:04:34.840266 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7dc39b6f-37d1-4250-afa7-a59dda59462c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 204 len: 0 microversion: 2.1 time: 0.130546 Sep 13 07:04:34.841167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 224/479] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:04:34 2022] DELETE /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:04:34.851000 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-536f0f82-c5f5-41cf-9d61-a2df15c667de tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:34.851526 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-536f0f82-c5f5-41cf-9d61-a2df15c667de tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:34.855986 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:34.863730 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-536f0f82-c5f5-41cf-9d61-a2df15c667de tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:34.864937 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-536f0f82-c5f5-41cf-9d61-a2df15c667de tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:34.865456 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-536f0f82-c5f5-41cf-9d61-a2df15c667de tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:34.866291 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-536f0f82-c5f5-41cf-9d61-a2df15c667de tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:34.866861 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-536f0f82-c5f5-41cf-9d61-a2df15c667de tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:34.867375 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-536f0f82-c5f5-41cf-9d61-a2df15c667de tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:35.055967 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7672b50e-39ac-463b-b5ae-2febccdcd4ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:35.056960 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7672b50e-39ac-463b-b5ae-2febccdcd4ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:35.067092 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-536f0f82-c5f5-41cf-9d61-a2df15c667de tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:35.075301 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7672b50e-39ac-463b-b5ae-2febccdcd4ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:35.077403 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7672b50e-39ac-463b-b5ae-2febccdcd4ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:35.077997 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7672b50e-39ac-463b-b5ae-2febccdcd4ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:35.080945 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7672b50e-39ac-463b-b5ae-2febccdcd4ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:35.082559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7672b50e-39ac-463b-b5ae-2febccdcd4ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:35.083024 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7672b50e-39ac-463b-b5ae-2febccdcd4ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:35.088536 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-536f0f82-c5f5-41cf-9d61-a2df15c667de tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1678 microversion: 2.1 time: 0.239382 Sep 13 07:04:35.093031 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 256/480] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:34 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1678 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:35.326963 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7672b50e-39ac-463b-b5ae-2febccdcd4ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:35.343146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7672b50e-39ac-463b-b5ae-2febccdcd4ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:35.345132 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7672b50e-39ac-463b-b5ae-2febccdcd4ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:35.346360 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7672b50e-39ac-463b-b5ae-2febccdcd4ca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1808 microversion: 2.20 time: 0.302780 Sep 13 07:04:35.346877 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 225/481] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:35 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1808 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:35.532646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4948f54c-6338-4d33-96ef-9cf1e9f78535 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:35.533256 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4948f54c-6338-4d33-96ef-9cf1e9f78535 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:35.540070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4948f54c-6338-4d33-96ef-9cf1e9f78535 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:35.540750 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4948f54c-6338-4d33-96ef-9cf1e9f78535 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:35.541956 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4948f54c-6338-4d33-96ef-9cf1e9f78535 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:35.543383 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4948f54c-6338-4d33-96ef-9cf1e9f78535 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:35.543383 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4948f54c-6338-4d33-96ef-9cf1e9f78535 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:35.543383 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4948f54c-6338-4d33-96ef-9cf1e9f78535 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:35.807494 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4948f54c-6338-4d33-96ef-9cf1e9f78535 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:35.816170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4948f54c-6338-4d33-96ef-9cf1e9f78535 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1260 microversion: 2.1 time: 0.287413 Sep 13 07:04:35.816957 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 257/482] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:35 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1260 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:36.116073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-77bdd2df-93aa-434f-bb14-e02091df0368 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:36.116725 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-77bdd2df-93aa-434f-bb14-e02091df0368 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:36.125743 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-77bdd2df-93aa-434f-bb14-e02091df0368 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:36.126194 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-77bdd2df-93aa-434f-bb14-e02091df0368 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:36.126739 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-77bdd2df-93aa-434f-bb14-e02091df0368 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:36.127454 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-77bdd2df-93aa-434f-bb14-e02091df0368 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:36.127902 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-77bdd2df-93aa-434f-bb14-e02091df0368 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:36.128503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-77bdd2df-93aa-434f-bb14-e02091df0368 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:36.146415 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:36.287904 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-77bdd2df-93aa-434f-bb14-e02091df0368 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:36.296870 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-77bdd2df-93aa-434f-bb14-e02091df0368 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1678 microversion: 2.1 time: 0.184879 Sep 13 07:04:36.297831 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 226/483] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:36 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:36.374684 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-46a9cb8a-0be6-492b-b590-055830ce89bd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:36.375460 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-46a9cb8a-0be6-492b-b590-055830ce89bd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:36.381769 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-46a9cb8a-0be6-492b-b590-055830ce89bd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:36.382417 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-46a9cb8a-0be6-492b-b590-055830ce89bd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:36.382963 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-46a9cb8a-0be6-492b-b590-055830ce89bd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:36.383758 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-46a9cb8a-0be6-492b-b590-055830ce89bd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:36.384503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-46a9cb8a-0be6-492b-b590-055830ce89bd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:36.386041 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-46a9cb8a-0be6-492b-b590-055830ce89bd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:36.455565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e84aaa5b-f490-455b-ae85-b0d1efe90034 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Action: 'create', calling method: .version_select at 0x7f4c199b7700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-206741384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDWkPDJxLYJeE9dl3pf7oJGLTQkxt+UPBgQvdN1AIpmBFhYUDaWRvo/E3zxrVWvdCUuoZInVb4S3IYsmJWYmcEhJaJqBwblZ9rpS/uK2ZOSQ6qAn4lxVD8uwEKupNpF9g=="}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:36.488336 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-e84aaa5b-f490-455b-ae85-b0d1efe90034 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Getting quotas for project 99bbe5cbd59f4feda4da45f2b14bd09b. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:04:36.492540 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-e84aaa5b-f490-455b-ae85-b0d1efe90034 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Getting quotas for user 67fa873d16414749bc478a59de3ec5b4 and project 99bbe5cbd59f4feda4da45f2b14bd09b. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:04:36.523996 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e84aaa5b-f490-455b-ae85-b0d1efe90034 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.276808 Sep 13 07:04:36.530652 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-46a9cb8a-0be6-492b-b590-055830ce89bd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:36.531633 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 258/484] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Sep 13 07:04:36 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:04:36.540320 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-46a9cb8a-0be6-492b-b590-055830ce89bd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:36.542363 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-46a9cb8a-0be6-492b-b590-055830ce89bd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:36.543915 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-46a9cb8a-0be6-492b-b590-055830ce89bd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1808 microversion: 2.20 time: 0.173236 Sep 13 07:04:36.559144 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 227/485] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:36 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:04:36.839478 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d9c8c4cb-8310-4939-93c7-78454813777e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:36.840087 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d9c8c4cb-8310-4939-93c7-78454813777e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:36.847559 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d9c8c4cb-8310-4939-93c7-78454813777e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:36.848109 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d9c8c4cb-8310-4939-93c7-78454813777e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:36.848536 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d9c8c4cb-8310-4939-93c7-78454813777e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:36.849222 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d9c8c4cb-8310-4939-93c7-78454813777e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:36.849665 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d9c8c4cb-8310-4939-93c7-78454813777e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:36.850111 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d9c8c4cb-8310-4939-93c7-78454813777e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:36.999518 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d9c8c4cb-8310-4939-93c7-78454813777e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:37.008035 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d9c8c4cb-8310-4939-93c7-78454813777e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1260 microversion: 2.1 time: 0.172554 Sep 13 07:04:37.015897 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 259/486] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:36 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:37.327230 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b2623e4d-a499-4d04-af24-a30162e947b0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:37.328618 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b2623e4d-a499-4d04-af24-a30162e947b0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:37.335298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2623e4d-a499-4d04-af24-a30162e947b0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:37.335852 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2623e4d-a499-4d04-af24-a30162e947b0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:37.336329 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2623e4d-a499-4d04-af24-a30162e947b0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:37.337100 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2623e4d-a499-4d04-af24-a30162e947b0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:37.337566 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2623e4d-a499-4d04-af24-a30162e947b0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:37.338222 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2623e4d-a499-4d04-af24-a30162e947b0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:37.496348 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b2623e4d-a499-4d04-af24-a30162e947b0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:37.504186 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b2623e4d-a499-4d04-af24-a30162e947b0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1678 microversion: 2.1 time: 0.186074 Sep 13 07:04:37.504770 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 228/487] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:37 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:37.571380 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2f3893e6-efa8-4f12-81b3-dfcf41c6ce7d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:37.572208 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2f3893e6-efa8-4f12-81b3-dfcf41c6ce7d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:37.579287 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2f3893e6-efa8-4f12-81b3-dfcf41c6ce7d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:37.579865 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2f3893e6-efa8-4f12-81b3-dfcf41c6ce7d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:37.580357 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2f3893e6-efa8-4f12-81b3-dfcf41c6ce7d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:37.581154 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2f3893e6-efa8-4f12-81b3-dfcf41c6ce7d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:37.581668 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2f3893e6-efa8-4f12-81b3-dfcf41c6ce7d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:37.582236 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2f3893e6-efa8-4f12-81b3-dfcf41c6ce7d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:37.748327 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2f3893e6-efa8-4f12-81b3-dfcf41c6ce7d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:37.758277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2f3893e6-efa8-4f12-81b3-dfcf41c6ce7d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:37.760489 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2f3893e6-efa8-4f12-81b3-dfcf41c6ce7d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:37.761686 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2f3893e6-efa8-4f12-81b3-dfcf41c6ce7d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1808 microversion: 2.20 time: 0.194922 Sep 13 07:04:37.762319 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 260/488] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:37 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:38.032448 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3f762d70-62fc-47c7-abee-da5d8846f379 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:38.033060 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3f762d70-62fc-47c7-abee-da5d8846f379 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:38.040502 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f762d70-62fc-47c7-abee-da5d8846f379 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:38.041015 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f762d70-62fc-47c7-abee-da5d8846f379 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:38.041523 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f762d70-62fc-47c7-abee-da5d8846f379 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:38.042260 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f762d70-62fc-47c7-abee-da5d8846f379 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:38.042714 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f762d70-62fc-47c7-abee-da5d8846f379 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:38.043135 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f762d70-62fc-47c7-abee-da5d8846f379 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:38.369689 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3f762d70-62fc-47c7-abee-da5d8846f379 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:38.389319 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3f762d70-62fc-47c7-abee-da5d8846f379 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1260 microversion: 2.1 time: 0.360694 Sep 13 07:04:38.407870 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 229/489] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:38 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1260 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:38.530331 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-029a6986-803e-4f0c-975e-94f7131a6e9d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:38.531213 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-029a6986-803e-4f0c-975e-94f7131a6e9d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:38.544031 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-029a6986-803e-4f0c-975e-94f7131a6e9d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:38.544700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-029a6986-803e-4f0c-975e-94f7131a6e9d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:38.545135 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-029a6986-803e-4f0c-975e-94f7131a6e9d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:38.545918 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-029a6986-803e-4f0c-975e-94f7131a6e9d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:38.546331 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-029a6986-803e-4f0c-975e-94f7131a6e9d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:38.546749 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-029a6986-803e-4f0c-975e-94f7131a6e9d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:38.787614 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-61fb4041-4a2a-4e80-9db6-bdeebce140c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:38.788514 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-61fb4041-4a2a-4e80-9db6-bdeebce140c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:38.794980 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61fb4041-4a2a-4e80-9db6-bdeebce140c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:38.796455 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61fb4041-4a2a-4e80-9db6-bdeebce140c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:38.797099 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61fb4041-4a2a-4e80-9db6-bdeebce140c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:38.798009 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61fb4041-4a2a-4e80-9db6-bdeebce140c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:38.798698 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61fb4041-4a2a-4e80-9db6-bdeebce140c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:38.799527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61fb4041-4a2a-4e80-9db6-bdeebce140c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:38.821686 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-029a6986-803e-4f0c-975e-94f7131a6e9d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:38.832625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-029a6986-803e-4f0c-975e-94f7131a6e9d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1678 microversion: 2.1 time: 0.305933 Sep 13 07:04:38.847844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 261/490] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:38 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1678 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:39.008129 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-61fb4041-4a2a-4e80-9db6-bdeebce140c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:39.021616 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-61fb4041-4a2a-4e80-9db6-bdeebce140c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:39.023683 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-61fb4041-4a2a-4e80-9db6-bdeebce140c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:39.027143 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-61fb4041-4a2a-4e80-9db6-bdeebce140c3 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1808 microversion: 2.20 time: 0.243456 Sep 13 07:04:39.027895 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 230/491] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:38 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:39.317863 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-2d236a88-f9f8-4d59-ba86-756f59f19abf req-28e2462c-2ef8-4edb-b10d-defbdde8ba80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d57882a-892f-4b45-a8ec-7b6f4b21b0ad", "name": "network-vif-plugged", "status": "completed", "tag": "447e368f-71d6-49ce-be81-226ee22458f1"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:39.331562 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-2d236a88-f9f8-4d59-ba86-756f59f19abf req-28e2462c-2ef8-4edb-b10d-defbdde8ba80 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:39.332033 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-2d236a88-f9f8-4d59-ba86-756f59f19abf req-28e2462c-2ef8-4edb-b10d-defbdde8ba80 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:39.332447 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-2d236a88-f9f8-4d59-ba86-756f59f19abf req-28e2462c-2ef8-4edb-b10d-defbdde8ba80 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:39.348875 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-2d236a88-f9f8-4d59-ba86-756f59f19abf req-28e2462c-2ef8-4edb-b10d-defbdde8ba80 service nova] Creating event network-vif-plugged:447e368f-71d6-49ce-be81-226ee22458f1 for instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad on hv-cinder-85694 Sep 13 07:04:39.359820 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-2d236a88-f9f8-4d59-ba86-756f59f19abf req-28e2462c-2ef8-4edb-b10d-defbdde8ba80 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057979 Sep 13 07:04:39.360427 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 262/492] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:04:39.416261 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3c0f5ea1-f2e7-4264-89df-7d656a2f5c20 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:39.417114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3c0f5ea1-f2e7-4264-89df-7d656a2f5c20 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:39.425621 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3c0f5ea1-f2e7-4264-89df-7d656a2f5c20 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:39.426507 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3c0f5ea1-f2e7-4264-89df-7d656a2f5c20 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:39.427170 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3c0f5ea1-f2e7-4264-89df-7d656a2f5c20 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:39.428073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3c0f5ea1-f2e7-4264-89df-7d656a2f5c20 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:39.428711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3c0f5ea1-f2e7-4264-89df-7d656a2f5c20 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:39.429924 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3c0f5ea1-f2e7-4264-89df-7d656a2f5c20 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:39.491245 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-e294beec-2953-4e32-9162-471e168c26b5 req-1ad87733-9c10-4bde-9dba-ba79740e24bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9c0b75-cd49-4a40-bd4c-24ab750fd439", "name": "network-vif-deleted", "tag": "db48239f-b745-42d1-9812-35356ecdcc86"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:39.504089 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e294beec-2953-4e32-9162-471e168c26b5 req-1ad87733-9c10-4bde-9dba-ba79740e24bf service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:39.504850 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e294beec-2953-4e32-9162-471e168c26b5 req-1ad87733-9c10-4bde-9dba-ba79740e24bf service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:39.505427 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e294beec-2953-4e32-9162-471e168c26b5 req-1ad87733-9c10-4bde-9dba-ba79740e24bf service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:39.538258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-e294beec-2953-4e32-9162-471e168c26b5 req-1ad87733-9c10-4bde-9dba-ba79740e24bf service nova] Creating event network-vif-deleted:db48239f-b745-42d1-9812-35356ecdcc86 for instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 on hv-cinder-85694 Sep 13 07:04:39.552331 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-e294beec-2953-4e32-9162-471e168c26b5 req-1ad87733-9c10-4bde-9dba-ba79740e24bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066750 Sep 13 07:04:39.555147 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 263/493] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:04:39.638187 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3c0f5ea1-f2e7-4264-89df-7d656a2f5c20 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:39.652704 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3c0f5ea1-f2e7-4264-89df-7d656a2f5c20 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1260 microversion: 2.1 time: 0.242988 Sep 13 07:04:39.654720 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 231/494] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:39 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1260 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:39.858648 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c0c22689-2136-4146-a492-49534008a3c2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:39.859627 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c0c22689-2136-4146-a492-49534008a3c2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:39.869239 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0c22689-2136-4146-a492-49534008a3c2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:39.869859 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0c22689-2136-4146-a492-49534008a3c2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:39.870548 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0c22689-2136-4146-a492-49534008a3c2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:39.871484 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0c22689-2136-4146-a492-49534008a3c2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:39.872138 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0c22689-2136-4146-a492-49534008a3c2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:39.872762 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0c22689-2136-4146-a492-49534008a3c2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:39.973337 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c0c22689-2136-4146-a492-49534008a3c2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:39.995791 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c0c22689-2136-4146-a492-49534008a3c2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 200 len: 1611 microversion: 2.1 time: 0.142687 Sep 13 07:04:39.998705 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 264/495] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:39 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 1611 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:04:40.059050 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e12e493e-e71b-4a03-84f3-acc0fd65715b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:40.059909 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e12e493e-e71b-4a03-84f3-acc0fd65715b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:40.068876 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e12e493e-e71b-4a03-84f3-acc0fd65715b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:40.069391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e12e493e-e71b-4a03-84f3-acc0fd65715b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:40.077863 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e12e493e-e71b-4a03-84f3-acc0fd65715b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:40.078910 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e12e493e-e71b-4a03-84f3-acc0fd65715b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:40.081352 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e12e493e-e71b-4a03-84f3-acc0fd65715b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:40.082040 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e12e493e-e71b-4a03-84f3-acc0fd65715b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:40.596961 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e12e493e-e71b-4a03-84f3-acc0fd65715b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:40.609572 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e12e493e-e71b-4a03-84f3-acc0fd65715b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:40.611445 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e12e493e-e71b-4a03-84f3-acc0fd65715b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:40.613038 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e12e493e-e71b-4a03-84f3-acc0fd65715b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1808 microversion: 2.20 time: 0.559170 Sep 13 07:04:40.630629 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 232/496] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:40 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1808 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:40.678115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-08c8540d-b901-420f-8626-765999909c61 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:40.679229 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-08c8540d-b901-420f-8626-765999909c61 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:40.686051 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-08c8540d-b901-420f-8626-765999909c61 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:40.686890 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-08c8540d-b901-420f-8626-765999909c61 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:40.687858 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-08c8540d-b901-420f-8626-765999909c61 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:40.688807 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-08c8540d-b901-420f-8626-765999909c61 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:40.690325 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-08c8540d-b901-420f-8626-765999909c61 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:40.691375 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-08c8540d-b901-420f-8626-765999909c61 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:40.928747 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-08c8540d-b901-420f-8626-765999909c61 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:40.937220 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-08c8540d-b901-420f-8626-765999909c61 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1260 microversion: 2.1 time: 0.263916 Sep 13 07:04:40.951011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 265/497] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:40 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1260 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:41.020361 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-99d0edbe-0038-468d-bfe2-ffbb274ff5a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:41.021014 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-99d0edbe-0038-468d-bfe2-ffbb274ff5a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:41.027466 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-99d0edbe-0038-468d-bfe2-ffbb274ff5a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:41.028180 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-99d0edbe-0038-468d-bfe2-ffbb274ff5a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:41.028606 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-99d0edbe-0038-468d-bfe2-ffbb274ff5a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:41.029310 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-99d0edbe-0038-468d-bfe2-ffbb274ff5a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:41.029758 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-99d0edbe-0038-468d-bfe2-ffbb274ff5a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:41.030233 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-99d0edbe-0038-468d-bfe2-ffbb274ff5a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:41.046526 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-99d0edbe-0038-468d-bfe2-ffbb274ff5a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] HTTP exception thrown: Instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 could not be found. Sep 13 07:04:41.048716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-99d0edbe-0038-468d-bfe2-ffbb274ff5a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Request method failure captured: Sep 13 07:04:41.048716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 HTTP/1.1 Sep 13 07:04:41.048716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:04:41.048716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:04:41.048716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:04:41.048716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:04:41.048716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:04:41.048716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:04:41.048716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:04:41.048716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:04:41.048716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICqyV8ZDoWvOKN7yB2xTUSeGEw-19LbL5z3b7FCDIrTHuyvYi1pO573AgmLpQMkZe3-u2HyPkAvEThrpkgPF3Y3DpDsAGrmh9FoN2kYrWow6jJnFAoIJGNoEoe53GgBmZUC7q0mN4-e6vnmtsq8cJkNCfkZrjfSjeL4PS70F44wGPd0 Sep 13 07:04:41.048716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:04:41.048716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:04:41.048716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:04:41.048716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:04:41.048716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:04:41.048716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:04:41.048716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:04:41.048716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:04:41.048716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:04:41.048716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:04:41.049990 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8c7dc05c1c9d40b2bb0defc9dd157d6e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:04:41.049990 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:04:41.049990 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:04:41.049990 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:04:41.049990 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:04:41.049990 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:04:41.049990 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:04:41.049990 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: 5a0fd7347cad41bc80f427f872cf78fa Sep 13 07:04:41.049990 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:04:41.049990 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:04:41.049990 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 could not be found. Sep 13 07:04:41.049990 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': '9e9c0b75-cd49-4a40-bd4c-24ab750fd439'} Sep 13 07:04:41.050780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:04:41.050780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:04:41.050780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:04:41.050780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:04:41.050780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:04:41.050780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:04:41.050780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:04:41.050780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:04:41.050780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:04:41.050780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:04:41.050780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 could not be found. Sep 13 07:04:41.050780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:04:41.050780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:04:41.050780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:04:41.050780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:04:41.050780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:04:41.050780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:04:41.050780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:04:41.050780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:04:41.050780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:04:41.052134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:04:41.052134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:04:41.052134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:04:41.052134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:04:41.052134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:04:41.052134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:04:41.052134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:04:41.052134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 could not be found. Sep 13 07:04:41.052134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:04:41.052134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:04:41.052134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:04:41.052134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:04:41.052134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:04:41.052134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:04:41.052134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:04:41.052134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:04:41.052134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 could not be found. Sep 13 07:04:41.052134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:04:41.054013 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-99d0edbe-0038-468d-bfe2-ffbb274ff5a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Returning 404 to user: Instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:04:41.054013 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-99d0edbe-0038-468d-bfe2-ffbb274ff5a5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 404 len: 111 microversion: 2.1 time: 0.033895 Sep 13 07:04:41.054013 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 233/498] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:41 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:04:41.061064 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-20464399-ee90-42ec-9fdc-d5a1cddb1b62 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '.version_select at 0x7f4c1985a940>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:41.091824 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-20464399-ee90-42ec-9fdc-d5a1cddb1b62 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-404433140" status: 202 len: 0 microversion: 2.1 time: 0.034596 Sep 13 07:04:41.094438 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 266/499] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Sep 13 07:04:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-404433140 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:04:41.638996 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b9885fdf-9c6c-4a7e-b66d-08ddf94f4f92 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:41.650398 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b9885fdf-9c6c-4a7e-b66d-08ddf94f4f92 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:41.658034 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b9885fdf-9c6c-4a7e-b66d-08ddf94f4f92 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:41.658551 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b9885fdf-9c6c-4a7e-b66d-08ddf94f4f92 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:41.659012 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b9885fdf-9c6c-4a7e-b66d-08ddf94f4f92 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:41.659900 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b9885fdf-9c6c-4a7e-b66d-08ddf94f4f92 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:41.660336 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b9885fdf-9c6c-4a7e-b66d-08ddf94f4f92 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:41.660755 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b9885fdf-9c6c-4a7e-b66d-08ddf94f4f92 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:41.897221 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b9885fdf-9c6c-4a7e-b66d-08ddf94f4f92 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:41.907865 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b9885fdf-9c6c-4a7e-b66d-08ddf94f4f92 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:41.909317 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b9885fdf-9c6c-4a7e-b66d-08ddf94f4f92 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:41.910895 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b9885fdf-9c6c-4a7e-b66d-08ddf94f4f92 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1808 microversion: 2.20 time: 0.276155 Sep 13 07:04:41.911731 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 234/500] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:41 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:41.956776 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-730b649e-c508-4b43-98d6-a4e3d5fce7cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:41.957993 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-730b649e-c508-4b43-98d6-a4e3d5fce7cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:41.962074 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9d2df9a8-ae30-4035-af2e-39bc84be8290 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:41.963035 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9d2df9a8-ae30-4035-af2e-39bc84be8290 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:41.966697 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-730b649e-c508-4b43-98d6-a4e3d5fce7cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:41.967435 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-730b649e-c508-4b43-98d6-a4e3d5fce7cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:41.967857 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-730b649e-c508-4b43-98d6-a4e3d5fce7cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:41.968711 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-730b649e-c508-4b43-98d6-a4e3d5fce7cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:41.969154 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-730b649e-c508-4b43-98d6-a4e3d5fce7cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:41.969375 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d2df9a8-ae30-4035-af2e-39bc84be8290 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:41.969599 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-730b649e-c508-4b43-98d6-a4e3d5fce7cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:41.970106 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d2df9a8-ae30-4035-af2e-39bc84be8290 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:41.970723 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d2df9a8-ae30-4035-af2e-39bc84be8290 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:41.971456 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d2df9a8-ae30-4035-af2e-39bc84be8290 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:41.972356 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d2df9a8-ae30-4035-af2e-39bc84be8290 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:41.973012 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d2df9a8-ae30-4035-af2e-39bc84be8290 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:42.115854 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-730b649e-c508-4b43-98d6-a4e3d5fce7cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lazy-loading 'services' on Instance uuid 98fc8f3f-7357-45fd-b982-ea283b3b33dd {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:04:42.140383 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9d2df9a8-ae30-4035-af2e-39bc84be8290 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:42.148674 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9d2df9a8-ae30-4035-af2e-39bc84be8290 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1260 microversion: 2.1 time: 0.190611 Sep 13 07:04:42.149242 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 235/501] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:41 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:04:42.249140 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-730b649e-c508-4b43-98d6-a4e3d5fce7cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "DELETE /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd/os-volume_attachments/c6751156-b7a1-49fc-8c48-aaa808bcdc38" status: 202 len: 0 microversion: 2.1 time: 0.296816 Sep 13 07:04:42.249901 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 267/502] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Sep 13 07:04:41 2022] DELETE /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd/os-volume_attachments/c6751156-b7a1-49fc-8c48-aaa808bcdc38 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:04:42.258627 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-43dfe503-25fb-4062-8552-5e4f64244bd1 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:42.261240 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-43dfe503-25fb-4062-8552-5e4f64244bd1 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:42.267999 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43dfe503-25fb-4062-8552-5e4f64244bd1 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:42.268479 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43dfe503-25fb-4062-8552-5e4f64244bd1 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:42.268907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43dfe503-25fb-4062-8552-5e4f64244bd1 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:42.269600 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43dfe503-25fb-4062-8552-5e4f64244bd1 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:42.270046 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43dfe503-25fb-4062-8552-5e4f64244bd1 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:42.270530 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43dfe503-25fb-4062-8552-5e4f64244bd1 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:42.300782 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-43dfe503-25fb-4062-8552-5e4f64244bd1 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046346 Sep 13 07:04:42.301360 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 236/503] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Sep 13 07:04:42 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:04:42.938553 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b9a8f40c-9df1-4d7c-87ee-9c7685f2769b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:42.939212 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b9a8f40c-9df1-4d7c-87ee-9c7685f2769b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:42.945991 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9a8f40c-9df1-4d7c-87ee-9c7685f2769b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:42.946522 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9a8f40c-9df1-4d7c-87ee-9c7685f2769b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:42.946953 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9a8f40c-9df1-4d7c-87ee-9c7685f2769b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:42.947633 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9a8f40c-9df1-4d7c-87ee-9c7685f2769b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:42.948081 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9a8f40c-9df1-4d7c-87ee-9c7685f2769b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:42.948495 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9a8f40c-9df1-4d7c-87ee-9c7685f2769b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:43.098348 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b9a8f40c-9df1-4d7c-87ee-9c7685f2769b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:43.108270 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b9a8f40c-9df1-4d7c-87ee-9c7685f2769b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:43.109891 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b9a8f40c-9df1-4d7c-87ee-9c7685f2769b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:43.111377 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b9a8f40c-9df1-4d7c-87ee-9c7685f2769b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1808 microversion: 2.20 time: 0.177174 Sep 13 07:04:43.111935 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 268/504] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:42 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:43.170988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5716e24a-7135-43ca-a62c-ca737186723a tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:43.171592 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5716e24a-7135-43ca-a62c-ca737186723a tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:43.178577 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5716e24a-7135-43ca-a62c-ca737186723a tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:43.179065 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5716e24a-7135-43ca-a62c-ca737186723a tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:43.179548 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5716e24a-7135-43ca-a62c-ca737186723a tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:43.180413 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5716e24a-7135-43ca-a62c-ca737186723a tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:43.182023 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5716e24a-7135-43ca-a62c-ca737186723a tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:43.182519 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5716e24a-7135-43ca-a62c-ca737186723a tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:43.317213 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c0ab7e67-78fd-4add-b7f9-d946491bad83 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:43.319579 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c0ab7e67-78fd-4add-b7f9-d946491bad83 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:43.327122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0ab7e67-78fd-4add-b7f9-d946491bad83 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:43.327829 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0ab7e67-78fd-4add-b7f9-d946491bad83 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:43.328491 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0ab7e67-78fd-4add-b7f9-d946491bad83 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:43.330587 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0ab7e67-78fd-4add-b7f9-d946491bad83 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:43.331059 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0ab7e67-78fd-4add-b7f9-d946491bad83 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:43.331484 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0ab7e67-78fd-4add-b7f9-d946491bad83 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:43.338355 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5716e24a-7135-43ca-a62c-ca737186723a tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:43.347151 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5716e24a-7135-43ca-a62c-ca737186723a tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1260 microversion: 2.1 time: 0.179921 Sep 13 07:04:43.348020 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 237/505] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:43 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:43.369686 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c0ab7e67-78fd-4add-b7f9-d946491bad83 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056791 Sep 13 07:04:43.370290 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 269/506] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Sep 13 07:04:43 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:04:44.137290 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2226b489-3f0a-47f6-baa2-85fd532c8b43 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:44.137893 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2226b489-3f0a-47f6-baa2-85fd532c8b43 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:44.144304 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2226b489-3f0a-47f6-baa2-85fd532c8b43 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:44.144784 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2226b489-3f0a-47f6-baa2-85fd532c8b43 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:44.145212 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2226b489-3f0a-47f6-baa2-85fd532c8b43 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:44.145905 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2226b489-3f0a-47f6-baa2-85fd532c8b43 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:44.146384 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2226b489-3f0a-47f6-baa2-85fd532c8b43 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:44.146807 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2226b489-3f0a-47f6-baa2-85fd532c8b43 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:44.289122 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2226b489-3f0a-47f6-baa2-85fd532c8b43 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:44.298201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2226b489-3f0a-47f6-baa2-85fd532c8b43 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:44.299638 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2226b489-3f0a-47f6-baa2-85fd532c8b43 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:44.300816 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2226b489-3f0a-47f6-baa2-85fd532c8b43 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1795 microversion: 2.20 time: 0.167584 Sep 13 07:04:44.301376 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 238/507] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:04:44 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1795 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:04:44.375879 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c6e6f3c9-0967-4089-95c7-71637ae83323 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:44.376457 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c6e6f3c9-0967-4089-95c7-71637ae83323 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:44.386223 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9c5ca4e9-cabe-4675-b819-727053e5f332 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:44.388147 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9c5ca4e9-cabe-4675-b819-727053e5f332 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:44.390015 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6e6f3c9-0967-4089-95c7-71637ae83323 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:44.391754 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6e6f3c9-0967-4089-95c7-71637ae83323 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:44.392873 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6e6f3c9-0967-4089-95c7-71637ae83323 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:44.394015 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6e6f3c9-0967-4089-95c7-71637ae83323 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:44.394927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6e6f3c9-0967-4089-95c7-71637ae83323 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:44.395364 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6e6f3c9-0967-4089-95c7-71637ae83323 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:44.396870 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9c5ca4e9-cabe-4675-b819-727053e5f332 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:44.397352 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9c5ca4e9-cabe-4675-b819-727053e5f332 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:44.397787 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9c5ca4e9-cabe-4675-b819-727053e5f332 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:44.398567 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9c5ca4e9-cabe-4675-b819-727053e5f332 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:44.399075 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9c5ca4e9-cabe-4675-b819-727053e5f332 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:44.399581 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9c5ca4e9-cabe-4675-b819-727053e5f332 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:44.431548 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9c5ca4e9-cabe-4675-b819-727053e5f332 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052430 Sep 13 07:04:44.432097 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 239/508] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Sep 13 07:04:44 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:04:44.536565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c6e6f3c9-0967-4089-95c7-71637ae83323 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:44.546003 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c6e6f3c9-0967-4089-95c7-71637ae83323 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1260 microversion: 2.1 time: 0.175696 Sep 13 07:04:44.546674 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 270/509] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:44 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:45.095593 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-852bddcf-bdeb-46ec-abba-667b3b02aad1 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:45.098198 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-852bddcf-bdeb-46ec-abba-667b3b02aad1 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:45.105218 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-852bddcf-bdeb-46ec-abba-667b3b02aad1 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:45.106034 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-852bddcf-bdeb-46ec-abba-667b3b02aad1 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:45.106580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-852bddcf-bdeb-46ec-abba-667b3b02aad1 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:45.107339 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-852bddcf-bdeb-46ec-abba-667b3b02aad1 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:45.107883 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-852bddcf-bdeb-46ec-abba-667b3b02aad1 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:45.108291 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-852bddcf-bdeb-46ec-abba-667b3b02aad1 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:45.183791 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-852bddcf-bdeb-46ec-abba-667b3b02aad1 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "POST /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015/action" status: 202 len: 0 microversion: 2.1 time: 0.091389 Sep 13 07:04:45.184383 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 240/510] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Sep 13 07:04:45 2022] POST /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:04:45.193325 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dc0cf711-92be-4e4b-8953-221b33c24f37 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:45.193922 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-dc0cf711-92be-4e4b-8953-221b33c24f37 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:45.213130 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc0cf711-92be-4e4b-8953-221b33c24f37 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:45.213625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc0cf711-92be-4e4b-8953-221b33c24f37 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:45.214121 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc0cf711-92be-4e4b-8953-221b33c24f37 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:45.214868 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc0cf711-92be-4e4b-8953-221b33c24f37 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:45.215322 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc0cf711-92be-4e4b-8953-221b33c24f37 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:45.215762 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc0cf711-92be-4e4b-8953-221b33c24f37 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:45.413438 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-dc0cf711-92be-4e4b-8953-221b33c24f37 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:45.417277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:45.425460 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dc0cf711-92be-4e4b-8953-221b33c24f37 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1750 microversion: 2.1 time: 0.236197 Sep 13 07:04:45.426108 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 271/511] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:45 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1750 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:45.449849 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e4d53013-a26a-4a69-996a-e9a01af2b472 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:45.452074 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e4d53013-a26a-4a69-996a-e9a01af2b472 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:45.458675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4d53013-a26a-4a69-996a-e9a01af2b472 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:45.459158 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4d53013-a26a-4a69-996a-e9a01af2b472 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:45.459600 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4d53013-a26a-4a69-996a-e9a01af2b472 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:45.460303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4d53013-a26a-4a69-996a-e9a01af2b472 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:45.460749 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4d53013-a26a-4a69-996a-e9a01af2b472 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:45.461166 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4d53013-a26a-4a69-996a-e9a01af2b472 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:45.492773 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e4d53013-a26a-4a69-996a-e9a01af2b472 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052865 Sep 13 07:04:45.493338 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 241/512] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Sep 13 07:04:45 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 07:04:45.559684 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ae76f52e-0979-4a9c-a1a6-ae20168e15cc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:45.560232 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ae76f52e-0979-4a9c-a1a6-ae20168e15cc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:45.571402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-413c674f-53fa-4289-8833-938f30988af3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:45.572009 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-413c674f-53fa-4289-8833-938f30988af3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:45.576155 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae76f52e-0979-4a9c-a1a6-ae20168e15cc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:45.576746 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae76f52e-0979-4a9c-a1a6-ae20168e15cc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:45.577263 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae76f52e-0979-4a9c-a1a6-ae20168e15cc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:45.578110 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae76f52e-0979-4a9c-a1a6-ae20168e15cc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:45.578851 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae76f52e-0979-4a9c-a1a6-ae20168e15cc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:45.579230 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-413c674f-53fa-4289-8833-938f30988af3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:45.579442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae76f52e-0979-4a9c-a1a6-ae20168e15cc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:45.579723 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-413c674f-53fa-4289-8833-938f30988af3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:45.580151 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-413c674f-53fa-4289-8833-938f30988af3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:45.581039 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-413c674f-53fa-4289-8833-938f30988af3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:45.581646 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-413c674f-53fa-4289-8833-938f30988af3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:45.582094 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-413c674f-53fa-4289-8833-938f30988af3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:45.604079 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:45.610322 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ae76f52e-0979-4a9c-a1a6-ae20168e15cc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:04:45.700706 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ae76f52e-0979-4a9c-a1a6-ae20168e15cc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "DELETE /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 204 len: 0 microversion: 2.1 time: 0.145914 Sep 13 07:04:45.701190 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 272/513] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:04:45 2022] DELETE /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:04:45.717371 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ba0c5777-a098-4927-aa6b-3f30a397c252 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:45.718625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ba0c5777-a098-4927-aa6b-3f30a397c252 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:45.727232 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba0c5777-a098-4927-aa6b-3f30a397c252 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:45.727720 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba0c5777-a098-4927-aa6b-3f30a397c252 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:45.728183 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba0c5777-a098-4927-aa6b-3f30a397c252 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:45.728882 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba0c5777-a098-4927-aa6b-3f30a397c252 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:45.729426 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba0c5777-a098-4927-aa6b-3f30a397c252 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:45.729783 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba0c5777-a098-4927-aa6b-3f30a397c252 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:45.784981 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-413c674f-53fa-4289-8833-938f30988af3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:45.792852 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-413c674f-53fa-4289-8833-938f30988af3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1260 microversion: 2.1 time: 0.225766 Sep 13 07:04:45.806104 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 242/514] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:45 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:04:45.872249 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ba0c5777-a098-4927-aa6b-3f30a397c252 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:45.880450 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ba0c5777-a098-4927-aa6b-3f30a397c252 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1681 microversion: 2.1 time: 0.173623 Sep 13 07:04:45.881020 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 273/515] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:45 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:46.458992 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-84018e79-976b-4ee7-bb6d-d399b3d0ee47 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:46.460058 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-84018e79-976b-4ee7-bb6d-d399b3d0ee47 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:46.468506 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84018e79-976b-4ee7-bb6d-d399b3d0ee47 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:46.468990 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84018e79-976b-4ee7-bb6d-d399b3d0ee47 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:46.469420 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84018e79-976b-4ee7-bb6d-d399b3d0ee47 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:46.470133 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84018e79-976b-4ee7-bb6d-d399b3d0ee47 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:46.470615 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84018e79-976b-4ee7-bb6d-d399b3d0ee47 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:46.471032 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84018e79-976b-4ee7-bb6d-d399b3d0ee47 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:46.626622 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-84018e79-976b-4ee7-bb6d-d399b3d0ee47 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:46.635191 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-84018e79-976b-4ee7-bb6d-d399b3d0ee47 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1750 microversion: 2.1 time: 0.183016 Sep 13 07:04:46.635727 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 243/516] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:46 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1750 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:46.822281 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6016fb11-2d2c-4c7a-a242-80d91d3b102a tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:46.823199 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6016fb11-2d2c-4c7a-a242-80d91d3b102a tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:46.826987 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=4 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:46.841911 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6016fb11-2d2c-4c7a-a242-80d91d3b102a tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:46.842432 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6016fb11-2d2c-4c7a-a242-80d91d3b102a tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:46.842867 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6016fb11-2d2c-4c7a-a242-80d91d3b102a tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:46.843565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6016fb11-2d2c-4c7a-a242-80d91d3b102a tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:46.844017 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6016fb11-2d2c-4c7a-a242-80d91d3b102a tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:46.844433 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6016fb11-2d2c-4c7a-a242-80d91d3b102a tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:46.903641 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-62117302-0eea-45df-8364-88fd8160c9f7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:46.904287 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-62117302-0eea-45df-8364-88fd8160c9f7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:46.910455 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-62117302-0eea-45df-8364-88fd8160c9f7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:46.910937 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-62117302-0eea-45df-8364-88fd8160c9f7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:46.911367 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-62117302-0eea-45df-8364-88fd8160c9f7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:46.912059 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-62117302-0eea-45df-8364-88fd8160c9f7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:46.912527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-62117302-0eea-45df-8364-88fd8160c9f7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:46.912945 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-62117302-0eea-45df-8364-88fd8160c9f7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:47.021329 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6016fb11-2d2c-4c7a-a242-80d91d3b102a tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:47.029661 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6016fb11-2d2c-4c7a-a242-80d91d3b102a tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1260 microversion: 2.1 time: 0.214587 Sep 13 07:04:47.030293 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 274/517] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:46 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:47.066986 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-62117302-0eea-45df-8364-88fd8160c9f7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:47.075591 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-62117302-0eea-45df-8364-88fd8160c9f7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1681 microversion: 2.1 time: 0.175600 Sep 13 07:04:47.076127 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 244/518] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:46 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:04:47.235999 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-407e8d4f-b8eb-44f1-aa13-a2687700b733 req-19ee6b2a-f813-4d8d-b55c-2dca182cfab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d695cc83-d3c5-44c9-af4a-2f0e67a96adf", "name": "network-vif-plugged", "status": "completed", "tag": "a7477596-3b59-40f9-9676-9d56b3b3aba4"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:47.246369 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-407e8d4f-b8eb-44f1-aa13-a2687700b733 req-19ee6b2a-f813-4d8d-b55c-2dca182cfab0 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:47.246850 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-407e8d4f-b8eb-44f1-aa13-a2687700b733 req-19ee6b2a-f813-4d8d-b55c-2dca182cfab0 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:47.247347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-407e8d4f-b8eb-44f1-aa13-a2687700b733 req-19ee6b2a-f813-4d8d-b55c-2dca182cfab0 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:47.258827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-407e8d4f-b8eb-44f1-aa13-a2687700b733 req-19ee6b2a-f813-4d8d-b55c-2dca182cfab0 service nova] Creating event network-vif-plugged:a7477596-3b59-40f9-9676-9d56b3b3aba4 for instance d695cc83-d3c5-44c9-af4a-2f0e67a96adf on hv-cinder-85694 Sep 13 07:04:47.263793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-407e8d4f-b8eb-44f1-aa13-a2687700b733 req-19ee6b2a-f813-4d8d-b55c-2dca182cfab0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031477 Sep 13 07:04:47.264378 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 275/519] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:04:47.665076 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-48496bc9-3dd4-42fa-8f38-d343ce245279 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:47.665738 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-48496bc9-3dd4-42fa-8f38-d343ce245279 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:47.672654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48496bc9-3dd4-42fa-8f38-d343ce245279 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:47.673146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48496bc9-3dd4-42fa-8f38-d343ce245279 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:47.673575 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48496bc9-3dd4-42fa-8f38-d343ce245279 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:47.674307 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48496bc9-3dd4-42fa-8f38-d343ce245279 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:47.674749 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48496bc9-3dd4-42fa-8f38-d343ce245279 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:47.675180 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48496bc9-3dd4-42fa-8f38-d343ce245279 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:47.844010 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-48496bc9-3dd4-42fa-8f38-d343ce245279 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:47.852987 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-48496bc9-3dd4-42fa-8f38-d343ce245279 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1750 microversion: 2.1 time: 0.191914 Sep 13 07:04:47.853573 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 245/520] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:47 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1750 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:48.053319 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-79263a3d-1959-49ff-a844-dcea29d53cc3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:48.053941 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-79263a3d-1959-49ff-a844-dcea29d53cc3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:48.060991 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79263a3d-1959-49ff-a844-dcea29d53cc3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:48.061474 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79263a3d-1959-49ff-a844-dcea29d53cc3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:48.061911 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79263a3d-1959-49ff-a844-dcea29d53cc3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:48.062662 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79263a3d-1959-49ff-a844-dcea29d53cc3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:48.063169 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79263a3d-1959-49ff-a844-dcea29d53cc3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:48.063664 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79263a3d-1959-49ff-a844-dcea29d53cc3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:48.103071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-334c687f-02f9-40e8-9ecf-d79bcac4f17d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:48.103680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-334c687f-02f9-40e8-9ecf-d79bcac4f17d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:48.110289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-334c687f-02f9-40e8-9ecf-d79bcac4f17d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:48.110751 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-334c687f-02f9-40e8-9ecf-d79bcac4f17d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:48.111182 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-334c687f-02f9-40e8-9ecf-d79bcac4f17d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:48.111919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-334c687f-02f9-40e8-9ecf-d79bcac4f17d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:48.112368 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-334c687f-02f9-40e8-9ecf-d79bcac4f17d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:48.112793 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-334c687f-02f9-40e8-9ecf-d79bcac4f17d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:48.367107 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-79263a3d-1959-49ff-a844-dcea29d53cc3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:48.375619 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-79263a3d-1959-49ff-a844-dcea29d53cc3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1260 microversion: 2.1 time: 0.327162 Sep 13 07:04:48.376213 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 276/521] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:48 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1260 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:48.378455 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-334c687f-02f9-40e8-9ecf-d79bcac4f17d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:48.386382 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-334c687f-02f9-40e8-9ecf-d79bcac4f17d tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1681 microversion: 2.1 time: 0.287218 Sep 13 07:04:48.387003 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 246/522] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:48 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1681 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:04:48.883298 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-98ced783-69bb-4333-844f-f24ddf7ab976 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:48.884160 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-98ced783-69bb-4333-844f-f24ddf7ab976 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:48.892320 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-98ced783-69bb-4333-844f-f24ddf7ab976 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:48.892810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-98ced783-69bb-4333-844f-f24ddf7ab976 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:48.893232 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-98ced783-69bb-4333-844f-f24ddf7ab976 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:48.893921 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-98ced783-69bb-4333-844f-f24ddf7ab976 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:48.894403 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-98ced783-69bb-4333-844f-f24ddf7ab976 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:48.894826 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-98ced783-69bb-4333-844f-f24ddf7ab976 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:49.080865 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-98ced783-69bb-4333-844f-f24ddf7ab976 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:49.091726 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-98ced783-69bb-4333-844f-f24ddf7ab976 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1755 microversion: 2.1 time: 0.215178 Sep 13 07:04:49.092339 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 277/523] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:48 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1755 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:49.398329 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0169d66c-3ba5-4d86-bf42-2ce5abd65932 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:49.398942 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0169d66c-3ba5-4d86-bf42-2ce5abd65932 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:49.405481 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0169d66c-3ba5-4d86-bf42-2ce5abd65932 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:49.405966 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0169d66c-3ba5-4d86-bf42-2ce5abd65932 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:49.406431 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0169d66c-3ba5-4d86-bf42-2ce5abd65932 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:49.407125 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0169d66c-3ba5-4d86-bf42-2ce5abd65932 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:49.407570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0169d66c-3ba5-4d86-bf42-2ce5abd65932 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:49.407951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0169d66c-3ba5-4d86-bf42-2ce5abd65932 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:49.410484 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-575d9b79-608d-4a27-842a-40a0d445c114 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:49.411316 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-575d9b79-608d-4a27-842a-40a0d445c114 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:49.418215 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-575d9b79-608d-4a27-842a-40a0d445c114 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:49.418732 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-575d9b79-608d-4a27-842a-40a0d445c114 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:49.419168 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-575d9b79-608d-4a27-842a-40a0d445c114 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:49.419864 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-575d9b79-608d-4a27-842a-40a0d445c114 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:49.420539 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-575d9b79-608d-4a27-842a-40a0d445c114 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:49.421103 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-575d9b79-608d-4a27-842a-40a0d445c114 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:49.680381 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0169d66c-3ba5-4d86-bf42-2ce5abd65932 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:49.683338 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-575d9b79-608d-4a27-842a-40a0d445c114 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:49.689344 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0169d66c-3ba5-4d86-bf42-2ce5abd65932 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1260 microversion: 2.1 time: 0.294967 Sep 13 07:04:49.691813 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-575d9b79-608d-4a27-842a-40a0d445c114 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1681 microversion: 2.1 time: 0.285488 Sep 13 07:04:49.692380 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 278/524] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:49 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1681 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:49.702140 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 247/525] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:49 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1260 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:50.061954 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-92085e0d-4aab-4160-ae33-c65c6026b35b req-407a444f-0ee4-440f-9fb7-b9d4fa76d832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98fc8f3f-7357-45fd-b982-ea283b3b33dd", "name": "network-vif-deleted", "tag": "ef18f87e-b4ae-437d-90c7-0368d0e8dc10"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:50.075632 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-92085e0d-4aab-4160-ae33-c65c6026b35b req-407a444f-0ee4-440f-9fb7-b9d4fa76d832 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:50.076113 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-92085e0d-4aab-4160-ae33-c65c6026b35b req-407a444f-0ee4-440f-9fb7-b9d4fa76d832 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:50.076544 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-92085e0d-4aab-4160-ae33-c65c6026b35b req-407a444f-0ee4-440f-9fb7-b9d4fa76d832 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:50.089606 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-92085e0d-4aab-4160-ae33-c65c6026b35b req-407a444f-0ee4-440f-9fb7-b9d4fa76d832 service nova] Creating event network-vif-deleted:ef18f87e-b4ae-437d-90c7-0368d0e8dc10 for instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd on hv-cinder-85694 Sep 13 07:04:50.094889 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-92085e0d-4aab-4160-ae33-c65c6026b35b req-407a444f-0ee4-440f-9fb7-b9d4fa76d832 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038771 Sep 13 07:04:50.095705 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 279/526] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:04:50.116156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-88318977-82d4-4b90-81d8-d89a5bf017c2 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:50.116771 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-88318977-82d4-4b90-81d8-d89a5bf017c2 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:50.123020 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-88318977-82d4-4b90-81d8-d89a5bf017c2 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:50.123501 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-88318977-82d4-4b90-81d8-d89a5bf017c2 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:50.123930 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-88318977-82d4-4b90-81d8-d89a5bf017c2 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:50.124629 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-88318977-82d4-4b90-81d8-d89a5bf017c2 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:50.125066 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-88318977-82d4-4b90-81d8-d89a5bf017c2 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:50.125475 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-88318977-82d4-4b90-81d8-d89a5bf017c2 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:50.282235 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-88318977-82d4-4b90-81d8-d89a5bf017c2 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:50.290858 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-88318977-82d4-4b90-81d8-d89a5bf017c2 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1755 microversion: 2.1 time: 0.178586 Sep 13 07:04:50.291736 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 248/527] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:50 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:50.713535 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-479ffbaa-a062-46b5-833f-3dfdf7007830 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:50.714309 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-479ffbaa-a062-46b5-833f-3dfdf7007830 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:50.721758 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6942e27e-48f5-40df-9086-6a5982125cf0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:50.722410 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6942e27e-48f5-40df-9086-6a5982125cf0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:50.736081 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6942e27e-48f5-40df-9086-6a5982125cf0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:50.739337 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6942e27e-48f5-40df-9086-6a5982125cf0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:50.739748 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6942e27e-48f5-40df-9086-6a5982125cf0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:50.740656 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6942e27e-48f5-40df-9086-6a5982125cf0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:50.740951 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-479ffbaa-a062-46b5-833f-3dfdf7007830 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:50.741455 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-479ffbaa-a062-46b5-833f-3dfdf7007830 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:50.741960 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-479ffbaa-a062-46b5-833f-3dfdf7007830 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:50.742819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6942e27e-48f5-40df-9086-6a5982125cf0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:50.743586 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-479ffbaa-a062-46b5-833f-3dfdf7007830 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:50.744027 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-479ffbaa-a062-46b5-833f-3dfdf7007830 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:50.744497 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-479ffbaa-a062-46b5-833f-3dfdf7007830 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:50.746749 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6942e27e-48f5-40df-9086-6a5982125cf0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:50.849374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6942e27e-48f5-40df-9086-6a5982125cf0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:50.860687 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6942e27e-48f5-40df-9086-6a5982125cf0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 200 len: 1326 microversion: 2.1 time: 0.143034 Sep 13 07:04:50.861411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 249/528] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:50 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 1326 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:50.920475 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-479ffbaa-a062-46b5-833f-3dfdf7007830 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:50.930212 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-479ffbaa-a062-46b5-833f-3dfdf7007830 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1444 microversion: 2.1 time: 0.221229 Sep 13 07:04:50.931144 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 280/529] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:50 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1444 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:04:50.953482 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c9b886ae-d2a7-48d7-9361-087ecac395a1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:50.954105 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c9b886ae-d2a7-48d7-9361-087ecac395a1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:50.960296 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c9b886ae-d2a7-48d7-9361-087ecac395a1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:50.960772 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c9b886ae-d2a7-48d7-9361-087ecac395a1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:50.961371 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c9b886ae-d2a7-48d7-9361-087ecac395a1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:50.962061 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c9b886ae-d2a7-48d7-9361-087ecac395a1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:50.962536 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c9b886ae-d2a7-48d7-9361-087ecac395a1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:50.962950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c9b886ae-d2a7-48d7-9361-087ecac395a1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:51.119182 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c9b886ae-d2a7-48d7-9361-087ecac395a1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:51.128094 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c9b886ae-d2a7-48d7-9361-087ecac395a1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1444 microversion: 2.1 time: 0.178584 Sep 13 07:04:51.129163 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 250/530] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:50 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1444 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:51.315083 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5d834509-ab2f-427c-b8db-f1bef96bebbc tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:51.315670 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5d834509-ab2f-427c-b8db-f1bef96bebbc tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:51.322846 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d834509-ab2f-427c-b8db-f1bef96bebbc tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:51.323433 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d834509-ab2f-427c-b8db-f1bef96bebbc tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:51.323974 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d834509-ab2f-427c-b8db-f1bef96bebbc tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:51.324707 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d834509-ab2f-427c-b8db-f1bef96bebbc tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:51.325161 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d834509-ab2f-427c-b8db-f1bef96bebbc tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:51.325777 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d834509-ab2f-427c-b8db-f1bef96bebbc tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:51.788453 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5d834509-ab2f-427c-b8db-f1bef96bebbc tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:51.797632 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5d834509-ab2f-427c-b8db-f1bef96bebbc tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1755 microversion: 2.1 time: 0.486399 Sep 13 07:04:51.798230 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 281/531] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:51 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1755 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:51.885057 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-73a3fd63-4463-4951-9ea8-3ffb185042ed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:51.885806 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-73a3fd63-4463-4951-9ea8-3ffb185042ed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:51.892978 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-73a3fd63-4463-4951-9ea8-3ffb185042ed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:51.893490 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-73a3fd63-4463-4951-9ea8-3ffb185042ed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:51.893911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-73a3fd63-4463-4951-9ea8-3ffb185042ed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:51.894609 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-73a3fd63-4463-4951-9ea8-3ffb185042ed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:51.895068 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-73a3fd63-4463-4951-9ea8-3ffb185042ed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:51.895480 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-73a3fd63-4463-4951-9ea8-3ffb185042ed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:51.910226 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-73a3fd63-4463-4951-9ea8-3ffb185042ed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] HTTP exception thrown: Instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd could not be found. Sep 13 07:04:51.911874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-73a3fd63-4463-4951-9ea8-3ffb185042ed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Request method failure captured: Sep 13 07:04:51.911874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd HTTP/1.1 Sep 13 07:04:51.911874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:04:51.911874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:04:51.911874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:04:51.911874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:04:51.911874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:04:51.911874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:04:51.911874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:04:51.911874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:04:51.911874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICqyV8ZDoWvOKN7yB2xTUSeGEw-19LbL5z3b7FCDIrTHuyvYi1pO573AgmLpQMkZe3-u2HyPkAvEThrpkgPF3Y3DpDsAGrmh9FoN2kYrWow6jJnFAoIJGNoEoe53GgBmZUC7q0mN4-e6vnmtsq8cJkNCfkZrjfSjeL4PS70F44wGPd0 Sep 13 07:04:51.911874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:04:51.911874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:04:51.911874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:04:51.911874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:04:51.911874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:04:51.911874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:04:51.911874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:04:51.911874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:04:51.911874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:04:51.911874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:04:51.913286 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8c7dc05c1c9d40b2bb0defc9dd157d6e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:04:51.913286 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:04:51.913286 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:04:51.913286 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:04:51.913286 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:04:51.913286 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:04:51.913286 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:04:51.913286 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: 5a0fd7347cad41bc80f427f872cf78fa Sep 13 07:04:51.913286 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:04:51.913286 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:04:51.913286 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd could not be found. Sep 13 07:04:51.913286 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': '98fc8f3f-7357-45fd-b982-ea283b3b33dd'} Sep 13 07:04:51.914298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:04:51.914298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:04:51.914298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:04:51.914298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:04:51.914298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:04:51.914298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:04:51.914298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:04:51.914298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:04:51.914298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:04:51.914298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:04:51.914298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd could not be found. Sep 13 07:04:51.914298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:04:51.914298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:04:51.914298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:04:51.914298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:04:51.914298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:04:51.914298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:04:51.914298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:04:51.914298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:04:51.914298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:04:51.916114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:04:51.916114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:04:51.916114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:04:51.916114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:04:51.916114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:04:51.916114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:04:51.916114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:04:51.916114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd could not be found. Sep 13 07:04:51.916114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:04:51.916114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:04:51.916114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:04:51.916114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:04:51.916114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:04:51.916114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:04:51.916114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:04:51.916114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:04:51.916114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd could not be found. Sep 13 07:04:51.916114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:04:51.917804 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-73a3fd63-4463-4951-9ea8-3ffb185042ed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Returning 404 to user: Instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:04:51.917804 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-73a3fd63-4463-4951-9ea8-3ffb185042ed tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 404 len: 111 microversion: 2.1 time: 0.032195 Sep 13 07:04:51.917804 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 251/532] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:51 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:04:51.923317 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a59d5c86-4a0a-4203-ac91-228cec2a7aee tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '.version_select at 0x7f4c196dab80>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:51.944624 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a59d5c86-4a0a-4203-ac91-228cec2a7aee tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-235911165" status: 202 len: 0 microversion: 2.1 time: 0.025517 Sep 13 07:04:51.945183 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 282/533] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Sep 13 07:04:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-235911165 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:04:52.639742 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d89a4287-14c5-4837-85b0-059690bc2c2c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Action: 'create', calling method: .version_select at 0x7f4c1966e5e0>, body: {"keypair": {"name": "tempest-keypair-635394839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtLYWDoqznH86/uD5BexntPfOge3A5wO1RNRZEqz0baYLOugOxJgtLf/i1Xm7HVx4b35dIEDeH/cyCyDAwQyV0zpD4s64TRRPlqccuoAwD3t0jg+0cXMCRMvePqGeEScA=="}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:52.661724 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-d89a4287-14c5-4837-85b0-059690bc2c2c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Getting quotas for project 8c7dc05c1c9d40b2bb0defc9dd157d6e. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:04:52.668532 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-d89a4287-14c5-4837-85b0-059690bc2c2c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Getting quotas for user 5a0fd7347cad41bc80f427f872cf78fa and project 8c7dc05c1c9d40b2bb0defc9dd157d6e. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:04:52.698321 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d89a4287-14c5-4837-85b0-059690bc2c2c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062679 Sep 13 07:04:52.698907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 252/534] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Sep 13 07:04:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:04:52.822352 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-58e952d9-2945-4c72-b574-d2454e0f1482 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:52.822972 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-58e952d9-2945-4c72-b574-d2454e0f1482 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:52.829856 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-58e952d9-2945-4c72-b574-d2454e0f1482 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:52.830410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-58e952d9-2945-4c72-b574-d2454e0f1482 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:52.830807 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-58e952d9-2945-4c72-b574-d2454e0f1482 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:52.831691 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-58e952d9-2945-4c72-b574-d2454e0f1482 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:52.832319 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-58e952d9-2945-4c72-b574-d2454e0f1482 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:52.833041 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-58e952d9-2945-4c72-b574-d2454e0f1482 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:53.152386 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-58e952d9-2945-4c72-b574-d2454e0f1482 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:53.162008 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-58e952d9-2945-4c72-b574-d2454e0f1482 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1755 microversion: 2.1 time: 0.344362 Sep 13 07:04:53.162822 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 283/535] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:52 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1755 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:53.471916 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-dc433aef-bbe4-4b40-95be-c483517a8319 req-aa73e4a1-66ff-45bb-b98b-9ac8ea55fc51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d695cc83-d3c5-44c9-af4a-2f0e67a96adf", "tag": "a7477596-3b59-40f9-9676-9d56b3b3aba4"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:53.483965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-dc433aef-bbe4-4b40-95be-c483517a8319 req-aa73e4a1-66ff-45bb-b98b-9ac8ea55fc51 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:53.484908 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-dc433aef-bbe4-4b40-95be-c483517a8319 req-aa73e4a1-66ff-45bb-b98b-9ac8ea55fc51 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:53.485563 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-dc433aef-bbe4-4b40-95be-c483517a8319 req-aa73e4a1-66ff-45bb-b98b-9ac8ea55fc51 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:53.497256 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-dc433aef-bbe4-4b40-95be-c483517a8319 req-aa73e4a1-66ff-45bb-b98b-9ac8ea55fc51 service nova] Creating event network-changed:a7477596-3b59-40f9-9676-9d56b3b3aba4 for instance d695cc83-d3c5-44c9-af4a-2f0e67a96adf on hv-cinder-85694 Sep 13 07:04:53.503722 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-dc433aef-bbe4-4b40-95be-c483517a8319 req-aa73e4a1-66ff-45bb-b98b-9ac8ea55fc51 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036343 Sep 13 07:04:53.505029 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 253/536] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:04:54.187707 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c63fccdc-2ef5-4814-83d8-0b06039a91dc tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:54.188971 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c63fccdc-2ef5-4814-83d8-0b06039a91dc tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:54.196180 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c63fccdc-2ef5-4814-83d8-0b06039a91dc tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:54.196668 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c63fccdc-2ef5-4814-83d8-0b06039a91dc tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:54.202232 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c63fccdc-2ef5-4814-83d8-0b06039a91dc tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:54.202232 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c63fccdc-2ef5-4814-83d8-0b06039a91dc tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:54.202232 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c63fccdc-2ef5-4814-83d8-0b06039a91dc tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:54.202232 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c63fccdc-2ef5-4814-83d8-0b06039a91dc tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:54.326619 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-752cd597-7fb0-48c2-a53c-f94ac4954a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1485347145", "imageRef": "19a6700e-e153-4bea-87aa-036bfccf0ecd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "672f9e05-334a-4483-b823-bb14da4544d0"}], "security_groups": [{"name": "tempest-securitygroup--2137943035"}], "key_name": "tempest-keypair-635394839", "user_data": "}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:54.388751 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c63fccdc-2ef5-4814-83d8-0b06039a91dc tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:54.397666 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c63fccdc-2ef5-4814-83d8-0b06039a91dc tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1755 microversion: 2.1 time: 0.214679 Sep 13 07:04:54.398226 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 284/537] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:54 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1755 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:54.451898 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-752cd597-7fb0-48c2-a53c-f94ac4954a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] validate_networks() for [('672f9e05-334a-4483-b823-bb14da4544d0', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:04:54.856691 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-752cd597-7fb0-48c2-a53c-f94ac4954a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:04:54.857757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-752cd597-7fb0-48c2-a53c-f94ac4954a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:04:54.858113 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-752cd597-7fb0-48c2-a53c-f94ac4954a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:04:54.858529 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-752cd597-7fb0-48c2-a53c-f94ac4954a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:04:54.858944 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-752cd597-7fb0-48c2-a53c-f94ac4954a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:04:54.870421 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-752cd597-7fb0-48c2-a53c-f94ac4954a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:54.870899 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-752cd597-7fb0-48c2-a53c-f94ac4954a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:54.871333 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-752cd597-7fb0-48c2-a53c-f94ac4954a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:54.872103 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-752cd597-7fb0-48c2-a53c-f94ac4954a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:54.872561 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-752cd597-7fb0-48c2-a53c-f94ac4954a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:54.873013 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-752cd597-7fb0-48c2-a53c-f94ac4954a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:54.890346 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-752cd597-7fb0-48c2-a53c-f94ac4954a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Getting quotas for project 8c7dc05c1c9d40b2bb0defc9dd157d6e. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:04:54.894556 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-752cd597-7fb0-48c2-a53c-f94ac4954a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Getting quotas for user 5a0fd7347cad41bc80f427f872cf78fa and project 8c7dc05c1c9d40b2bb0defc9dd157d6e. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:04:54.906331 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-752cd597-7fb0-48c2-a53c-f94ac4954a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:04:54.908717 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-752cd597-7fb0-48c2-a53c-f94ac4954a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='19a6700e-e153-4bea-87aa-036bfccf0ecd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:04:54.961499 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-752cd597-7fb0-48c2-a53c-f94ac4954a9e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.641787 Sep 13 07:04:54.962172 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 254/538] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Sep 13 07:04:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 07:04:54.973335 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-666c7317-5135-4d88-bb13-2d0047d772b9 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:54.973940 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-666c7317-5135-4d88-bb13-2d0047d772b9 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:55.031184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-666c7317-5135-4d88-bb13-2d0047d772b9 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:55.038589 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-666c7317-5135-4d88-bb13-2d0047d772b9 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1" status: 200 len: 1241 microversion: 2.1 time: 0.069102 Sep 13 07:04:55.039188 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 285/539] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:54 2022] GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:55.423102 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1766f6e3-9219-4439-b6a1-442a18eeb7aa tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:55.424533 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1766f6e3-9219-4439-b6a1-442a18eeb7aa tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:55.427250 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:55.436056 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1766f6e3-9219-4439-b6a1-442a18eeb7aa tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:55.436535 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1766f6e3-9219-4439-b6a1-442a18eeb7aa tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:55.436966 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1766f6e3-9219-4439-b6a1-442a18eeb7aa tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:55.437666 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1766f6e3-9219-4439-b6a1-442a18eeb7aa tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:55.438225 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1766f6e3-9219-4439-b6a1-442a18eeb7aa tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:55.438719 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1766f6e3-9219-4439-b6a1-442a18eeb7aa tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:55.593959 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1766f6e3-9219-4439-b6a1-442a18eeb7aa tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:55.611174 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1766f6e3-9219-4439-b6a1-442a18eeb7aa tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1755 microversion: 2.1 time: 0.192945 Sep 13 07:04:55.612789 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 255/540] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:55 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1755 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:55.777416 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9c7321f5-b1a4-4422-b762-ea5ec7d752fe tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1181902857", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-206741384", "security_groups": [{"name": "tempest-secgroup-smoke-2025561016"}], "block_device_mapping_v2": [{"uuid": "835ab3f4-ff9b-4be6-ab3e-1d2321efee28", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3420c970-55c8-47dc-908b-5f5f431cebe9"}]}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:55.894109 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-9c7321f5-b1a4-4422-b762-ea5ec7d752fe tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] validate_networks() for [('3420c970-55c8-47dc-908b-5f5f431cebe9', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:04:56.062574 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c2f77c7e-d08e-4517-a76e-45ff94ac8253 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:56.063168 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c2f77c7e-d08e-4517-a76e-45ff94ac8253 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:56.070434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c2f77c7e-d08e-4517-a76e-45ff94ac8253 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:56.070926 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c2f77c7e-d08e-4517-a76e-45ff94ac8253 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:56.071357 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c2f77c7e-d08e-4517-a76e-45ff94ac8253 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:56.072310 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c2f77c7e-d08e-4517-a76e-45ff94ac8253 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:56.072732 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c2f77c7e-d08e-4517-a76e-45ff94ac8253 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:56.073400 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c2f77c7e-d08e-4517-a76e-45ff94ac8253 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:56.078604 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:56.169480 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c2f77c7e-d08e-4517-a76e-45ff94ac8253 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:56.177549 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c2f77c7e-d08e-4517-a76e-45ff94ac8253 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1" status: 200 len: 1293 microversion: 2.1 time: 0.120087 Sep 13 07:04:56.178141 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 256/541] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:56 2022] GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 => generated 1293 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:56.348952 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-9c7321f5-b1a4-4422-b762-ea5ec7d752fe tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:04:56.349593 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-9c7321f5-b1a4-4422-b762-ea5ec7d752fe tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:04:56.350303 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-9c7321f5-b1a4-4422-b762-ea5ec7d752fe tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:04:56.350974 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-9c7321f5-b1a4-4422-b762-ea5ec7d752fe tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:04:56.352290 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-9c7321f5-b1a4-4422-b762-ea5ec7d752fe tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:04:56.362293 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c7321f5-b1a4-4422-b762-ea5ec7d752fe tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:56.362777 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c7321f5-b1a4-4422-b762-ea5ec7d752fe tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:56.363215 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c7321f5-b1a4-4422-b762-ea5ec7d752fe tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:56.363965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c7321f5-b1a4-4422-b762-ea5ec7d752fe tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:56.364414 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c7321f5-b1a4-4422-b762-ea5ec7d752fe tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:56.364832 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c7321f5-b1a4-4422-b762-ea5ec7d752fe tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:56.383605 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-9c7321f5-b1a4-4422-b762-ea5ec7d752fe tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Getting quotas for project 99bbe5cbd59f4feda4da45f2b14bd09b. Resources: {'instances', 'cores', 'ram'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:04:56.387824 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-9c7321f5-b1a4-4422-b762-ea5ec7d752fe tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Getting quotas for user 67fa873d16414749bc478a59de3ec5b4 and project 99bbe5cbd59f4feda4da45f2b14bd09b. Resources: {'instances', 'cores', 'ram'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:04:56.447704 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9c7321f5-b1a4-4422-b762-ea5ec7d752fe tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:04:56.449983 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9c7321f5-b1a4-4422-b762-ea5ec7d752fe tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='835ab3f4-ff9b-4be6-ab3e-1d2321efee28',volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:04:56.595871 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9c7321f5-b1a4-4422-b762-ea5ec7d752fe tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.822548 Sep 13 07:04:56.596775 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 286/542] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Sep 13 07:04:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 07:04:56.609522 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c479c3de-dbf0-407d-b2db-ec0682c9a8b5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:56.610524 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c479c3de-dbf0-407d-b2db-ec0682c9a8b5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:56.636446 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6ed06c69-f4a6-4af5-a5ac-548b0674fa78 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:56.637141 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6ed06c69-f4a6-4af5-a5ac-548b0674fa78 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:56.644569 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ed06c69-f4a6-4af5-a5ac-548b0674fa78 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:56.645138 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ed06c69-f4a6-4af5-a5ac-548b0674fa78 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:56.645635 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ed06c69-f4a6-4af5-a5ac-548b0674fa78 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:56.646431 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ed06c69-f4a6-4af5-a5ac-548b0674fa78 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:56.646950 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ed06c69-f4a6-4af5-a5ac-548b0674fa78 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:56.647437 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ed06c69-f4a6-4af5-a5ac-548b0674fa78 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:56.706423 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c479c3de-dbf0-407d-b2db-ec0682c9a8b5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:56.720992 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c479c3de-dbf0-407d-b2db-ec0682c9a8b5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1094 microversion: 2.1 time: 0.116505 Sep 13 07:04:56.721580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 257/543] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:56 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1094 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:56.870198 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6ed06c69-f4a6-4af5-a5ac-548b0674fa78 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:56.879610 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6ed06c69-f4a6-4af5-a5ac-548b0674fa78 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1755 microversion: 2.1 time: 0.248991 Sep 13 07:04:56.886794 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 287/544] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:56 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1755 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:04:57.202522 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8a7692d5-19f7-48dc-a14f-1dd606b60a3a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:57.203165 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8a7692d5-19f7-48dc-a14f-1dd606b60a3a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:57.210442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8a7692d5-19f7-48dc-a14f-1dd606b60a3a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:57.210930 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8a7692d5-19f7-48dc-a14f-1dd606b60a3a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:57.211359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8a7692d5-19f7-48dc-a14f-1dd606b60a3a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:57.212085 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8a7692d5-19f7-48dc-a14f-1dd606b60a3a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:57.212514 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8a7692d5-19f7-48dc-a14f-1dd606b60a3a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:57.212935 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8a7692d5-19f7-48dc-a14f-1dd606b60a3a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:57.363024 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8a7692d5-19f7-48dc-a14f-1dd606b60a3a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:57.372021 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8a7692d5-19f7-48dc-a14f-1dd606b60a3a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1" status: 200 len: 1299 microversion: 2.1 time: 0.174095 Sep 13 07:04:57.372756 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 258/545] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:57 2022] GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 => generated 1299 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:57.744237 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c52c21b0-7dc6-4b36-a3ca-a43c63a84736 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:57.744884 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c52c21b0-7dc6-4b36-a3ca-a43c63a84736 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:57.751580 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c52c21b0-7dc6-4b36-a3ca-a43c63a84736 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:57.752312 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c52c21b0-7dc6-4b36-a3ca-a43c63a84736 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:57.752739 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c52c21b0-7dc6-4b36-a3ca-a43c63a84736 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:57.753433 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c52c21b0-7dc6-4b36-a3ca-a43c63a84736 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:57.753877 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c52c21b0-7dc6-4b36-a3ca-a43c63a84736 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:57.754330 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c52c21b0-7dc6-4b36-a3ca-a43c63a84736 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:57.831037 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c52c21b0-7dc6-4b36-a3ca-a43c63a84736 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:57.838940 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c52c21b0-7dc6-4b36-a3ca-a43c63a84736 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1192 microversion: 2.1 time: 0.098791 Sep 13 07:04:57.839519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 288/546] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:57 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1192 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:57.903232 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-94e62a7b-6897-4571-a26a-4b588649a4d6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:57.903874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-94e62a7b-6897-4571-a26a-4b588649a4d6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:57.910213 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-94e62a7b-6897-4571-a26a-4b588649a4d6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:57.910675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-94e62a7b-6897-4571-a26a-4b588649a4d6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:57.911122 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-94e62a7b-6897-4571-a26a-4b588649a4d6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:57.911803 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-94e62a7b-6897-4571-a26a-4b588649a4d6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:57.912333 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-94e62a7b-6897-4571-a26a-4b588649a4d6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:57.912830 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-94e62a7b-6897-4571-a26a-4b588649a4d6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:58.194683 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-94e62a7b-6897-4571-a26a-4b588649a4d6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:58.210115 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-94e62a7b-6897-4571-a26a-4b588649a4d6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1755 microversion: 2.1 time: 0.310770 Sep 13 07:04:58.222640 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 259/547] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:57 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1755 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:58.397572 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-95f236a6-389d-48c2-8dca-eaa13b5052dc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:58.399568 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-95f236a6-389d-48c2-8dca-eaa13b5052dc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:58.407562 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95f236a6-389d-48c2-8dca-eaa13b5052dc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:58.408425 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95f236a6-389d-48c2-8dca-eaa13b5052dc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:58.409042 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95f236a6-389d-48c2-8dca-eaa13b5052dc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:58.409940 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95f236a6-389d-48c2-8dca-eaa13b5052dc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:58.410553 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95f236a6-389d-48c2-8dca-eaa13b5052dc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:58.411077 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95f236a6-389d-48c2-8dca-eaa13b5052dc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:58.431837 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-162f5fb1-dc80-41c0-98e1-6acf3f1571d2 req-86b9afe2-9ddc-4f1f-a117-6aaeef19e203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1", "tag": "b05c2df1-d6ff-46f8-807a-b0bddae18565"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:58.456563 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-162f5fb1-dc80-41c0-98e1-6acf3f1571d2 req-86b9afe2-9ddc-4f1f-a117-6aaeef19e203 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:58.457489 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-162f5fb1-dc80-41c0-98e1-6acf3f1571d2 req-86b9afe2-9ddc-4f1f-a117-6aaeef19e203 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:58.458263 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-162f5fb1-dc80-41c0-98e1-6acf3f1571d2 req-86b9afe2-9ddc-4f1f-a117-6aaeef19e203 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:58.472698 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-162f5fb1-dc80-41c0-98e1-6acf3f1571d2 req-86b9afe2-9ddc-4f1f-a117-6aaeef19e203 service nova] Creating event network-changed:b05c2df1-d6ff-46f8-807a-b0bddae18565 for instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 on hv-cinder-85694 Sep 13 07:04:58.478095 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-162f5fb1-dc80-41c0-98e1-6acf3f1571d2 req-86b9afe2-9ddc-4f1f-a117-6aaeef19e203 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050439 Sep 13 07:04:58.479232 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 260/548] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:04:58.621170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-95f236a6-389d-48c2-8dca-eaa13b5052dc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:58.629987 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-95f236a6-389d-48c2-8dca-eaa13b5052dc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1" status: 200 len: 1367 microversion: 2.1 time: 0.237866 Sep 13 07:04:58.642416 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 289/549] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:58 2022] GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:58.863417 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-32c96d8c-e626-455b-bca3-b98e88bd913a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:58.864304 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-32c96d8c-e626-455b-bca3-b98e88bd913a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:58.872652 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-32c96d8c-e626-455b-bca3-b98e88bd913a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:58.873398 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-32c96d8c-e626-455b-bca3-b98e88bd913a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:58.873984 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-32c96d8c-e626-455b-bca3-b98e88bd913a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:58.875070 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-32c96d8c-e626-455b-bca3-b98e88bd913a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:58.875666 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-32c96d8c-e626-455b-bca3-b98e88bd913a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:58.876228 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-32c96d8c-e626-455b-bca3-b98e88bd913a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:59.076550 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-32c96d8c-e626-455b-bca3-b98e88bd913a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:59.088970 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-32c96d8c-e626-455b-bca3-b98e88bd913a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1278 microversion: 2.1 time: 0.230065 Sep 13 07:04:59.090481 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 261/550] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:58 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1278 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:59.235102 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f6a89078-7d0f-4ce8-9252-a54794a240d4 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:59.235922 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f6a89078-7d0f-4ce8-9252-a54794a240d4 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:59.242886 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6a89078-7d0f-4ce8-9252-a54794a240d4 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:59.243492 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6a89078-7d0f-4ce8-9252-a54794a240d4 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:59.244077 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6a89078-7d0f-4ce8-9252-a54794a240d4 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:59.244839 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6a89078-7d0f-4ce8-9252-a54794a240d4 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:59.245395 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6a89078-7d0f-4ce8-9252-a54794a240d4 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:59.245843 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6a89078-7d0f-4ce8-9252-a54794a240d4 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:59.395324 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f6a89078-7d0f-4ce8-9252-a54794a240d4 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:59.398912 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:59.405092 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f6a89078-7d0f-4ce8-9252-a54794a240d4 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1755 microversion: 2.1 time: 0.174187 Sep 13 07:04:59.405672 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 290/551] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:59 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:04:59.653359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-61f692ec-70a9-466f-97b5-f91abe19ff08 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:04:59.654238 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-61f692ec-70a9-466f-97b5-f91abe19ff08 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:04:59.661007 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61f692ec-70a9-466f-97b5-f91abe19ff08 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:59.661740 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61f692ec-70a9-466f-97b5-f91abe19ff08 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:59.662215 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61f692ec-70a9-466f-97b5-f91abe19ff08 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:59.662909 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61f692ec-70a9-466f-97b5-f91abe19ff08 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:59.663363 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61f692ec-70a9-466f-97b5-f91abe19ff08 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:59.663784 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61f692ec-70a9-466f-97b5-f91abe19ff08 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:59.698069 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-221a4ccd-452e-4a35-b6ca-502091b971fe req-61441014-c13d-4d07-be5b-7e20cb666962 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df5f6f23-54e8-43b0-a5a3-6e336b2a3582", "tag": "a75edda5-2638-4320-afc1-42f9bdf0ed95"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:04:59.710233 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-221a4ccd-452e-4a35-b6ca-502091b971fe req-61441014-c13d-4d07-be5b-7e20cb666962 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:04:59.710713 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-221a4ccd-452e-4a35-b6ca-502091b971fe req-61441014-c13d-4d07-be5b-7e20cb666962 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:04:59.711336 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-221a4ccd-452e-4a35-b6ca-502091b971fe req-61441014-c13d-4d07-be5b-7e20cb666962 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:04:59.722987 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-221a4ccd-452e-4a35-b6ca-502091b971fe req-61441014-c13d-4d07-be5b-7e20cb666962 service nova] Creating event network-changed:a75edda5-2638-4320-afc1-42f9bdf0ed95 for instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 on hv-cinder-85694 Sep 13 07:04:59.729644 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-221a4ccd-452e-4a35-b6ca-502091b971fe req-61441014-c13d-4d07-be5b-7e20cb666962 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036557 Sep 13 07:04:59.730613 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 291/552] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:04:59.798180 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-61f692ec-70a9-466f-97b5-f91abe19ff08 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:04:59.808849 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-61f692ec-70a9-466f-97b5-f91abe19ff08 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1" status: 200 len: 1367 microversion: 2.1 time: 0.159201 Sep 13 07:04:59.809696 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 262/553] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:04:59 2022] GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:00.116762 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-248bfbd5-a18f-4dd7-9bb9-1af7c2a62f72 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:00.117615 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-248bfbd5-a18f-4dd7-9bb9-1af7c2a62f72 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:00.125748 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-248bfbd5-a18f-4dd7-9bb9-1af7c2a62f72 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:00.126258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-248bfbd5-a18f-4dd7-9bb9-1af7c2a62f72 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:00.126692 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-248bfbd5-a18f-4dd7-9bb9-1af7c2a62f72 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:00.127472 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-248bfbd5-a18f-4dd7-9bb9-1af7c2a62f72 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:00.127924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-248bfbd5-a18f-4dd7-9bb9-1af7c2a62f72 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:00.128337 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-248bfbd5-a18f-4dd7-9bb9-1af7c2a62f72 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:00.273282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-248bfbd5-a18f-4dd7-9bb9-1af7c2a62f72 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:00.281677 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-248bfbd5-a18f-4dd7-9bb9-1af7c2a62f72 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1278 microversion: 2.1 time: 0.171815 Sep 13 07:05:00.282378 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 292/554] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:00 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:00.433593 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e9d1cc39-a8b0-450f-bbda-88870ada8c34 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:00.435308 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e9d1cc39-a8b0-450f-bbda-88870ada8c34 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:00.445779 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e9d1cc39-a8b0-450f-bbda-88870ada8c34 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:00.446811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e9d1cc39-a8b0-450f-bbda-88870ada8c34 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:00.447500 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e9d1cc39-a8b0-450f-bbda-88870ada8c34 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:00.448627 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e9d1cc39-a8b0-450f-bbda-88870ada8c34 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:00.449364 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e9d1cc39-a8b0-450f-bbda-88870ada8c34 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:00.450275 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e9d1cc39-a8b0-450f-bbda-88870ada8c34 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:00.758693 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e9d1cc39-a8b0-450f-bbda-88870ada8c34 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:00.762307 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=100 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:00.768472 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e9d1cc39-a8b0-450f-bbda-88870ada8c34 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1755 microversion: 2.1 time: 0.342676 Sep 13 07:05:00.769031 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 263/555] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:00 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1755 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:00.832898 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-33bd90eb-bfb3-4210-86dd-cf66d1456c3e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:00.833777 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-33bd90eb-bfb3-4210-86dd-cf66d1456c3e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:00.840695 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33bd90eb-bfb3-4210-86dd-cf66d1456c3e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:00.841576 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33bd90eb-bfb3-4210-86dd-cf66d1456c3e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:00.842399 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33bd90eb-bfb3-4210-86dd-cf66d1456c3e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:00.843139 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33bd90eb-bfb3-4210-86dd-cf66d1456c3e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:00.843583 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33bd90eb-bfb3-4210-86dd-cf66d1456c3e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:00.844156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33bd90eb-bfb3-4210-86dd-cf66d1456c3e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:01.010377 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-33bd90eb-bfb3-4210-86dd-cf66d1456c3e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:01.018868 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-33bd90eb-bfb3-4210-86dd-cf66d1456c3e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1" status: 200 len: 1367 microversion: 2.1 time: 0.189865 Sep 13 07:05:01.019442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 293/556] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:00 2022] GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:01.304825 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9e061860-b5fe-4a7d-8fa7-de1ccc908d5d tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:01.305440 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9e061860-b5fe-4a7d-8fa7-de1ccc908d5d tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:01.312381 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e061860-b5fe-4a7d-8fa7-de1ccc908d5d tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:01.312867 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e061860-b5fe-4a7d-8fa7-de1ccc908d5d tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:01.313480 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e061860-b5fe-4a7d-8fa7-de1ccc908d5d tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:01.314244 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e061860-b5fe-4a7d-8fa7-de1ccc908d5d tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:01.314668 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e061860-b5fe-4a7d-8fa7-de1ccc908d5d tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:01.315090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e061860-b5fe-4a7d-8fa7-de1ccc908d5d tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:01.498010 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9e061860-b5fe-4a7d-8fa7-de1ccc908d5d tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:01.507211 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9e061860-b5fe-4a7d-8fa7-de1ccc908d5d tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1266 microversion: 2.1 time: 0.206266 Sep 13 07:05:01.507798 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 264/557] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:01 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:01.791982 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e06acb06-67ad-4da0-aa9c-46c866eafb4b tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:01.792491 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e06acb06-67ad-4da0-aa9c-46c866eafb4b tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:01.798980 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e06acb06-67ad-4da0-aa9c-46c866eafb4b tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:01.799466 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e06acb06-67ad-4da0-aa9c-46c866eafb4b tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:01.799903 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e06acb06-67ad-4da0-aa9c-46c866eafb4b tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:01.800596 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e06acb06-67ad-4da0-aa9c-46c866eafb4b tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:01.801043 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e06acb06-67ad-4da0-aa9c-46c866eafb4b tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:01.801471 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e06acb06-67ad-4da0-aa9c-46c866eafb4b tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:01.946766 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e06acb06-67ad-4da0-aa9c-46c866eafb4b tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:01.955966 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e06acb06-67ad-4da0-aa9c-46c866eafb4b tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1755 microversion: 2.1 time: 0.168101 Sep 13 07:05:01.956539 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 294/558] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:01 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:02.045134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ac936507-2844-444e-9a6d-186a9c2ea81f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:02.045882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ac936507-2844-444e-9a6d-186a9c2ea81f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:02.054907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac936507-2844-444e-9a6d-186a9c2ea81f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:02.055872 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac936507-2844-444e-9a6d-186a9c2ea81f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:02.056366 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac936507-2844-444e-9a6d-186a9c2ea81f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:02.057380 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac936507-2844-444e-9a6d-186a9c2ea81f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:02.057956 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac936507-2844-444e-9a6d-186a9c2ea81f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:02.058604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac936507-2844-444e-9a6d-186a9c2ea81f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:02.195460 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ac936507-2844-444e-9a6d-186a9c2ea81f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:02.204058 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ac936507-2844-444e-9a6d-186a9c2ea81f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1" status: 200 len: 1367 microversion: 2.1 time: 0.164644 Sep 13 07:05:02.204626 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 265/559] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:02 2022] GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:02.537140 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3f0602ad-7b92-41a2-9d7c-a06c354ec963 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:02.538166 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3f0602ad-7b92-41a2-9d7c-a06c354ec963 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:02.546756 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f0602ad-7b92-41a2-9d7c-a06c354ec963 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:02.547301 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f0602ad-7b92-41a2-9d7c-a06c354ec963 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:02.547659 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f0602ad-7b92-41a2-9d7c-a06c354ec963 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:02.548340 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f0602ad-7b92-41a2-9d7c-a06c354ec963 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:02.548781 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f0602ad-7b92-41a2-9d7c-a06c354ec963 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:02.549198 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f0602ad-7b92-41a2-9d7c-a06c354ec963 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:02.690512 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3f0602ad-7b92-41a2-9d7c-a06c354ec963 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:02.702245 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3f0602ad-7b92-41a2-9d7c-a06c354ec963 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1266 microversion: 2.1 time: 0.172002 Sep 13 07:05:02.702818 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 295/560] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:02 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:02.982516 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ed639de1-db1e-4158-a674-fa06a5b67a13 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:02.983992 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ed639de1-db1e-4158-a674-fa06a5b67a13 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:02.994014 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed639de1-db1e-4158-a674-fa06a5b67a13 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:02.994856 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed639de1-db1e-4158-a674-fa06a5b67a13 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:02.995527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed639de1-db1e-4158-a674-fa06a5b67a13 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:02.996690 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed639de1-db1e-4158-a674-fa06a5b67a13 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:02.997426 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed639de1-db1e-4158-a674-fa06a5b67a13 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:02.998235 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed639de1-db1e-4158-a674-fa06a5b67a13 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:03.142771 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ed639de1-db1e-4158-a674-fa06a5b67a13 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:03.151863 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ed639de1-db1e-4158-a674-fa06a5b67a13 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1755 microversion: 2.1 time: 0.175804 Sep 13 07:05:03.152471 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 266/561] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:02 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:03.227308 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-314841cc-fe09-4911-9bcc-3120c0d2bcd6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:03.227925 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-314841cc-fe09-4911-9bcc-3120c0d2bcd6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:03.235155 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-314841cc-fe09-4911-9bcc-3120c0d2bcd6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:03.235634 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-314841cc-fe09-4911-9bcc-3120c0d2bcd6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:03.236126 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-314841cc-fe09-4911-9bcc-3120c0d2bcd6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:03.236877 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-314841cc-fe09-4911-9bcc-3120c0d2bcd6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:03.237388 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-314841cc-fe09-4911-9bcc-3120c0d2bcd6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:03.237875 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-314841cc-fe09-4911-9bcc-3120c0d2bcd6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:03.292759 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-f18f973b-669f-414f-9fd4-cd517f29d358 req-ecefe98b-ba56-4aa7-8bd9-735d88c2a2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1", "name": "network-vif-plugged", "status": "completed", "tag": "b05c2df1-d6ff-46f8-807a-b0bddae18565"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:05:03.303969 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-f18f973b-669f-414f-9fd4-cd517f29d358 req-ecefe98b-ba56-4aa7-8bd9-735d88c2a2d5 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:03.304482 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-f18f973b-669f-414f-9fd4-cd517f29d358 req-ecefe98b-ba56-4aa7-8bd9-735d88c2a2d5 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:03.306095 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-f18f973b-669f-414f-9fd4-cd517f29d358 req-ecefe98b-ba56-4aa7-8bd9-735d88c2a2d5 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:03.319307 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-f18f973b-669f-414f-9fd4-cd517f29d358 req-ecefe98b-ba56-4aa7-8bd9-735d88c2a2d5 service nova] Creating event network-vif-plugged:b05c2df1-d6ff-46f8-807a-b0bddae18565 for instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 on hv-cinder-85694 Sep 13 07:05:03.325489 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-f18f973b-669f-414f-9fd4-cd517f29d358 req-ecefe98b-ba56-4aa7-8bd9-735d88c2a2d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036545 Sep 13 07:05:03.326138 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 267/562] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:05:03.381111 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-314841cc-fe09-4911-9bcc-3120c0d2bcd6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:03.390284 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-314841cc-fe09-4911-9bcc-3120c0d2bcd6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1" status: 200 len: 1367 microversion: 2.1 time: 0.166852 Sep 13 07:05:03.390882 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 296/563] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:03 2022] GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:03.732238 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5f130b0e-f860-4714-ac26-908c7cc30825 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:03.733668 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5f130b0e-f860-4714-ac26-908c7cc30825 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:03.745146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f130b0e-f860-4714-ac26-908c7cc30825 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:03.745956 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f130b0e-f860-4714-ac26-908c7cc30825 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:03.746760 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f130b0e-f860-4714-ac26-908c7cc30825 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:03.747949 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f130b0e-f860-4714-ac26-908c7cc30825 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:03.748741 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f130b0e-f860-4714-ac26-908c7cc30825 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:03.749222 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f130b0e-f860-4714-ac26-908c7cc30825 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:03.890800 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5f130b0e-f860-4714-ac26-908c7cc30825 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:03.899283 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5f130b0e-f860-4714-ac26-908c7cc30825 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1266 microversion: 2.1 time: 0.174340 Sep 13 07:05:03.899853 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 268/564] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:03 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:04.180409 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2cf38cac-6541-483a-80ab-fbcc070a020f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:04.181302 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2cf38cac-6541-483a-80ab-fbcc070a020f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:04.187785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2cf38cac-6541-483a-80ab-fbcc070a020f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:04.188273 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2cf38cac-6541-483a-80ab-fbcc070a020f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:04.188680 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2cf38cac-6541-483a-80ab-fbcc070a020f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:04.189401 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2cf38cac-6541-483a-80ab-fbcc070a020f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:04.189854 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2cf38cac-6541-483a-80ab-fbcc070a020f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:04.190308 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2cf38cac-6541-483a-80ab-fbcc070a020f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:04.344357 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2cf38cac-6541-483a-80ab-fbcc070a020f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:04.353470 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2cf38cac-6541-483a-80ab-fbcc070a020f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1755 microversion: 2.1 time: 0.179394 Sep 13 07:05:04.354036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 297/565] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:04 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:04.413203 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5151806d-6af0-4b72-bd83-1d835794cb32 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:04.413838 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5151806d-6af0-4b72-bd83-1d835794cb32 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:04.420886 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5151806d-6af0-4b72-bd83-1d835794cb32 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:04.421366 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5151806d-6af0-4b72-bd83-1d835794cb32 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:04.421797 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5151806d-6af0-4b72-bd83-1d835794cb32 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:04.422521 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5151806d-6af0-4b72-bd83-1d835794cb32 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:04.422971 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5151806d-6af0-4b72-bd83-1d835794cb32 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:04.423387 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5151806d-6af0-4b72-bd83-1d835794cb32 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:04.567647 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5151806d-6af0-4b72-bd83-1d835794cb32 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:04.575489 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5151806d-6af0-4b72-bd83-1d835794cb32 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1" status: 200 len: 1367 microversion: 2.1 time: 0.166207 Sep 13 07:05:04.576064 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 269/566] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:04 2022] GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:04.926558 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-638a651a-a658-4980-848b-205ed2bd23a1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:04.927594 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-638a651a-a658-4980-848b-205ed2bd23a1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:04.938492 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-638a651a-a658-4980-848b-205ed2bd23a1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:04.939278 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-638a651a-a658-4980-848b-205ed2bd23a1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:04.939986 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-638a651a-a658-4980-848b-205ed2bd23a1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:04.941111 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-638a651a-a658-4980-848b-205ed2bd23a1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:04.941850 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-638a651a-a658-4980-848b-205ed2bd23a1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:04.942583 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-638a651a-a658-4980-848b-205ed2bd23a1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:05.077356 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-638a651a-a658-4980-848b-205ed2bd23a1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:05.085571 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-638a651a-a658-4980-848b-205ed2bd23a1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1266 microversion: 2.1 time: 0.165993 Sep 13 07:05:05.086175 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 298/567] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:04 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:05.384010 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-11e4030d-3ab7-4566-8890-1cbc6e1add7e tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:05.384631 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-11e4030d-3ab7-4566-8890-1cbc6e1add7e tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:05.386623 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:05.392583 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-11e4030d-3ab7-4566-8890-1cbc6e1add7e tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:05.393064 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-11e4030d-3ab7-4566-8890-1cbc6e1add7e tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:05.393498 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-11e4030d-3ab7-4566-8890-1cbc6e1add7e tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:05.394212 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-11e4030d-3ab7-4566-8890-1cbc6e1add7e tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:05.394666 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-11e4030d-3ab7-4566-8890-1cbc6e1add7e tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:05.395086 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-11e4030d-3ab7-4566-8890-1cbc6e1add7e tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:05.540720 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-11e4030d-3ab7-4566-8890-1cbc6e1add7e tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:05.551043 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-11e4030d-3ab7-4566-8890-1cbc6e1add7e tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1755 microversion: 2.1 time: 0.170986 Sep 13 07:05:05.551624 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 270/568] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:05 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:05.603013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-33a097b7-6ea1-4b7e-adda-9e5fc8b48adf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:05.603552 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-33a097b7-6ea1-4b7e-adda-9e5fc8b48adf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:05.610579 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33a097b7-6ea1-4b7e-adda-9e5fc8b48adf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:05.611071 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33a097b7-6ea1-4b7e-adda-9e5fc8b48adf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:05.611503 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33a097b7-6ea1-4b7e-adda-9e5fc8b48adf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:05.612209 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33a097b7-6ea1-4b7e-adda-9e5fc8b48adf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:05.612669 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33a097b7-6ea1-4b7e-adda-9e5fc8b48adf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:05.613095 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33a097b7-6ea1-4b7e-adda-9e5fc8b48adf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:05.759890 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-33a097b7-6ea1-4b7e-adda-9e5fc8b48adf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:05.767841 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-33a097b7-6ea1-4b7e-adda-9e5fc8b48adf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1" status: 200 len: 1367 microversion: 2.1 time: 0.168744 Sep 13 07:05:05.768437 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 299/569] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:05 2022] GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:06.111526 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d046e11b-508a-4dbe-8288-4aae08b4882e tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:06.112158 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d046e11b-508a-4dbe-8288-4aae08b4882e tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:06.118625 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d046e11b-508a-4dbe-8288-4aae08b4882e tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:06.119124 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d046e11b-508a-4dbe-8288-4aae08b4882e tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:06.119571 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d046e11b-508a-4dbe-8288-4aae08b4882e tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:06.120280 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d046e11b-508a-4dbe-8288-4aae08b4882e tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:06.120782 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d046e11b-508a-4dbe-8288-4aae08b4882e tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:06.121215 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d046e11b-508a-4dbe-8288-4aae08b4882e tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:06.264606 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d046e11b-508a-4dbe-8288-4aae08b4882e tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:06.272980 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d046e11b-508a-4dbe-8288-4aae08b4882e tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1266 microversion: 2.1 time: 0.167344 Sep 13 07:05:06.273545 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 271/570] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:06 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:06.575186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-485e0b03-69c4-4bfe-b5d6-ef640731b089 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:06.575811 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-485e0b03-69c4-4bfe-b5d6-ef640731b089 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:06.578113 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:06.578635 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=8 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:06.585093 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-485e0b03-69c4-4bfe-b5d6-ef640731b089 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:06.585630 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-485e0b03-69c4-4bfe-b5d6-ef640731b089 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:06.586107 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-485e0b03-69c4-4bfe-b5d6-ef640731b089 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:06.587048 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-485e0b03-69c4-4bfe-b5d6-ef640731b089 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:06.587565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-485e0b03-69c4-4bfe-b5d6-ef640731b089 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:06.587984 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-485e0b03-69c4-4bfe-b5d6-ef640731b089 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:06.731327 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-485e0b03-69c4-4bfe-b5d6-ef640731b089 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:06.740486 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-485e0b03-69c4-4bfe-b5d6-ef640731b089 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1758 microversion: 2.1 time: 0.169170 Sep 13 07:05:06.741023 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 300/571] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:06 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:06.790862 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-804b08eb-ca15-40c1-8a8e-77a8014ee68f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:06.791476 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-804b08eb-ca15-40c1-8a8e-77a8014ee68f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:06.793821 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=12 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:06.803969 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-804b08eb-ca15-40c1-8a8e-77a8014ee68f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:06.804450 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-804b08eb-ca15-40c1-8a8e-77a8014ee68f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:06.804874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-804b08eb-ca15-40c1-8a8e-77a8014ee68f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:06.805879 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-804b08eb-ca15-40c1-8a8e-77a8014ee68f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:06.806388 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-804b08eb-ca15-40c1-8a8e-77a8014ee68f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:06.806800 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-804b08eb-ca15-40c1-8a8e-77a8014ee68f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:06.947361 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-804b08eb-ca15-40c1-8a8e-77a8014ee68f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:06.957072 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-804b08eb-ca15-40c1-8a8e-77a8014ee68f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1" status: 200 len: 1557 microversion: 2.1 time: 0.170168 Sep 13 07:05:06.957646 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 272/572] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:06 2022] GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 => generated 1557 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:06.979329 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0e1be8de-6fe2-4697-ad08-d00195d046ea tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:06.979738 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0e1be8de-6fe2-4697-ad08-d00195d046ea tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:06.985948 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0e1be8de-6fe2-4697-ad08-d00195d046ea tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:06.986453 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0e1be8de-6fe2-4697-ad08-d00195d046ea tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:06.986885 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0e1be8de-6fe2-4697-ad08-d00195d046ea tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:06.987567 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0e1be8de-6fe2-4697-ad08-d00195d046ea tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:06.988006 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0e1be8de-6fe2-4697-ad08-d00195d046ea tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:06.988416 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0e1be8de-6fe2-4697-ad08-d00195d046ea tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:07.068959 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0e1be8de-6fe2-4697-ad08-d00195d046ea tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093537 Sep 13 07:05:07.069557 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 301/573] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Sep 13 07:05:06 2022] GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:05:07.302045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7bf37693-77ec-40d5-816d-a87c061071b0 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:07.302589 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7bf37693-77ec-40d5-816d-a87c061071b0 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:07.309433 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7bf37693-77ec-40d5-816d-a87c061071b0 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:07.309971 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7bf37693-77ec-40d5-816d-a87c061071b0 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:07.310435 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7bf37693-77ec-40d5-816d-a87c061071b0 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:07.311129 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7bf37693-77ec-40d5-816d-a87c061071b0 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:07.311581 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7bf37693-77ec-40d5-816d-a87c061071b0 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:07.312218 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7bf37693-77ec-40d5-816d-a87c061071b0 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:07.556314 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7bf37693-77ec-40d5-816d-a87c061071b0 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:07.565119 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7bf37693-77ec-40d5-816d-a87c061071b0 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1266 microversion: 2.1 time: 0.267103 Sep 13 07:05:07.565710 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 273/574] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:07 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:08.295934 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1f085860-193d-4986-8a41-c6593c4f8614 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eda4bfe5-b992-4ff0-8e2d-219a18e30ca8"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:05:08.299052 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1f085860-193d-4986-8a41-c6593c4f8614 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:08.305229 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f085860-193d-4986-8a41-c6593c4f8614 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:08.306050 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f085860-193d-4986-8a41-c6593c4f8614 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:08.306789 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f085860-193d-4986-8a41-c6593c4f8614 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:08.307477 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f085860-193d-4986-8a41-c6593c4f8614 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:08.307920 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f085860-193d-4986-8a41-c6593c4f8614 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:08.308358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f085860-193d-4986-8a41-c6593c4f8614 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:08.379952 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-ff82f1b5-c70b-48f2-960c-95227e05774f req-04903294-ca63-47f3-a405-4e479cb02c11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1", "tag": "b05c2df1-d6ff-46f8-807a-b0bddae18565"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:05:08.390190 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-ff82f1b5-c70b-48f2-960c-95227e05774f req-04903294-ca63-47f3-a405-4e479cb02c11 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:08.390918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-ff82f1b5-c70b-48f2-960c-95227e05774f req-04903294-ca63-47f3-a405-4e479cb02c11 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:08.391487 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-ff82f1b5-c70b-48f2-960c-95227e05774f req-04903294-ca63-47f3-a405-4e479cb02c11 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:08.403092 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-ff82f1b5-c70b-48f2-960c-95227e05774f req-04903294-ca63-47f3-a405-4e479cb02c11 service nova] Creating event network-changed:b05c2df1-d6ff-46f8-807a-b0bddae18565 for instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 on hv-cinder-85694 Sep 13 07:05:08.408842 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-ff82f1b5-c70b-48f2-960c-95227e05774f req-04903294-ca63-47f3-a405-4e479cb02c11 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032533 Sep 13 07:05:08.409438 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 274/575] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:05:08.588706 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4c410b29-5c61-4d12-92e5-8fa78315a94f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:08.589396 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4c410b29-5c61-4d12-92e5-8fa78315a94f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:08.605161 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4c410b29-5c61-4d12-92e5-8fa78315a94f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:08.605659 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4c410b29-5c61-4d12-92e5-8fa78315a94f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:08.606113 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4c410b29-5c61-4d12-92e5-8fa78315a94f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:08.606833 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4c410b29-5c61-4d12-92e5-8fa78315a94f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:08.607286 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4c410b29-5c61-4d12-92e5-8fa78315a94f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:08.607708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4c410b29-5c61-4d12-92e5-8fa78315a94f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:08.685421 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1f085860-193d-4986-8a41-c6593c4f8614 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "POST /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.393756 Sep 13 07:05:08.688912 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 302/576] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Sep 13 07:05:08 2022] POST /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8/os-volume_attachments => generated 194 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:05:08.863476 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4c410b29-5c61-4d12-92e5-8fa78315a94f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:08.872017 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4c410b29-5c61-4d12-92e5-8fa78315a94f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1266 microversion: 2.1 time: 0.287441 Sep 13 07:05:08.873031 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 275/577] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:08 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:05:09.897217 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5a554eb2-b621-4665-b76c-11896bc45dd4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:09.898989 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5a554eb2-b621-4665-b76c-11896bc45dd4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:09.911124 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5a554eb2-b621-4665-b76c-11896bc45dd4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:09.911604 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5a554eb2-b621-4665-b76c-11896bc45dd4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:09.912025 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5a554eb2-b621-4665-b76c-11896bc45dd4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:09.912719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5a554eb2-b621-4665-b76c-11896bc45dd4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:09.913157 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5a554eb2-b621-4665-b76c-11896bc45dd4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:09.913573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5a554eb2-b621-4665-b76c-11896bc45dd4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:10.050246 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5a554eb2-b621-4665-b76c-11896bc45dd4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:10.058503 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5a554eb2-b621-4665-b76c-11896bc45dd4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1266 microversion: 2.1 time: 0.166285 Sep 13 07:05:10.059079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 303/578] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:09 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:11.084814 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1ebcd007-e74e-4e78-a38b-b376d325abcd tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:11.085746 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1ebcd007-e74e-4e78-a38b-b376d325abcd tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:11.095689 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ebcd007-e74e-4e78-a38b-b376d325abcd tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:11.096172 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ebcd007-e74e-4e78-a38b-b376d325abcd tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:11.096597 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ebcd007-e74e-4e78-a38b-b376d325abcd tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:11.097292 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ebcd007-e74e-4e78-a38b-b376d325abcd tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:11.097741 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ebcd007-e74e-4e78-a38b-b376d325abcd tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:11.098204 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ebcd007-e74e-4e78-a38b-b376d325abcd tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:11.232332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1ebcd007-e74e-4e78-a38b-b376d325abcd tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:11.240730 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1ebcd007-e74e-4e78-a38b-b376d325abcd tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1266 microversion: 2.1 time: 0.162441 Sep 13 07:05:11.241445 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 276/579] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:11 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:11.326559 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-3e7a515f-1aca-4d3b-8305-d1a08f4345fe req-5682e605-c784-46bf-926a-e27550d8d6ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df5f6f23-54e8-43b0-a5a3-6e336b2a3582", "name": "network-vif-plugged", "status": "completed", "tag": "a75edda5-2638-4320-afc1-42f9bdf0ed95"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:05:11.339582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3e7a515f-1aca-4d3b-8305-d1a08f4345fe req-5682e605-c784-46bf-926a-e27550d8d6ea service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:11.340060 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3e7a515f-1aca-4d3b-8305-d1a08f4345fe req-5682e605-c784-46bf-926a-e27550d8d6ea service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:11.340482 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3e7a515f-1aca-4d3b-8305-d1a08f4345fe req-5682e605-c784-46bf-926a-e27550d8d6ea service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:11.353052 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-3e7a515f-1aca-4d3b-8305-d1a08f4345fe req-5682e605-c784-46bf-926a-e27550d8d6ea service nova] Creating event network-vif-plugged:a75edda5-2638-4320-afc1-42f9bdf0ed95 for instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 on hv-cinder-85694 Sep 13 07:05:11.358053 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-3e7a515f-1aca-4d3b-8305-d1a08f4345fe req-5682e605-c784-46bf-926a-e27550d8d6ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036382 Sep 13 07:05:11.359025 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 304/580] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:05:12.267912 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-849d5eef-672c-4a0e-872d-0294fa0fccb2 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:12.268598 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-849d5eef-672c-4a0e-872d-0294fa0fccb2 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:12.276330 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-849d5eef-672c-4a0e-872d-0294fa0fccb2 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:12.276891 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-849d5eef-672c-4a0e-872d-0294fa0fccb2 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:12.277391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-849d5eef-672c-4a0e-872d-0294fa0fccb2 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:12.278303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-849d5eef-672c-4a0e-872d-0294fa0fccb2 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:12.278827 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-849d5eef-672c-4a0e-872d-0294fa0fccb2 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:12.279311 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-849d5eef-672c-4a0e-872d-0294fa0fccb2 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:12.419372 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-849d5eef-672c-4a0e-872d-0294fa0fccb2 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:12.427799 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-849d5eef-672c-4a0e-872d-0294fa0fccb2 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1266 microversion: 2.1 time: 0.166035 Sep 13 07:05:12.428367 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 277/581] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:12 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:13.456390 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d4ef6979-781e-4570-91b2-073e15d8d371 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:13.457316 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d4ef6979-781e-4570-91b2-073e15d8d371 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:13.468354 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d4ef6979-781e-4570-91b2-073e15d8d371 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:13.469061 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d4ef6979-781e-4570-91b2-073e15d8d371 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:13.469479 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d4ef6979-781e-4570-91b2-073e15d8d371 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:13.470210 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d4ef6979-781e-4570-91b2-073e15d8d371 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:13.470634 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d4ef6979-781e-4570-91b2-073e15d8d371 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:13.471049 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d4ef6979-781e-4570-91b2-073e15d8d371 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:13.614307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d4ef6979-781e-4570-91b2-073e15d8d371 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:13.622367 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d4ef6979-781e-4570-91b2-073e15d8d371 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1454 microversion: 2.1 time: 0.173004 Sep 13 07:05:13.622928 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 305/582] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:13 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:13.644452 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-64067a2a-fa3a-496e-b072-4cbef05ae32b tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:13.645026 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-64067a2a-fa3a-496e-b072-4cbef05ae32b tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:13.651641 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64067a2a-fa3a-496e-b072-4cbef05ae32b tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:13.652114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64067a2a-fa3a-496e-b072-4cbef05ae32b tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:13.652562 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64067a2a-fa3a-496e-b072-4cbef05ae32b tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:13.653223 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64067a2a-fa3a-496e-b072-4cbef05ae32b tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:13.653668 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64067a2a-fa3a-496e-b072-4cbef05ae32b tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:13.654100 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64067a2a-fa3a-496e-b072-4cbef05ae32b tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:13.791435 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-64067a2a-fa3a-496e-b072-4cbef05ae32b tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:13.799669 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-64067a2a-fa3a-496e-b072-4cbef05ae32b tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1454 microversion: 2.1 time: 0.159123 Sep 13 07:05:13.800229 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 278/583] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:13 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:15.731178 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-11a71d95-01b2-4b33-b297-065af37f0e69 req-8396d9b0-64aa-45e3-8799-8c025d62be53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df5f6f23-54e8-43b0-a5a3-6e336b2a3582", "tag": "a75edda5-2638-4320-afc1-42f9bdf0ed95"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:05:15.741769 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-11a71d95-01b2-4b33-b297-065af37f0e69 req-8396d9b0-64aa-45e3-8799-8c025d62be53 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:15.742283 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-11a71d95-01b2-4b33-b297-065af37f0e69 req-8396d9b0-64aa-45e3-8799-8c025d62be53 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:15.742712 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-11a71d95-01b2-4b33-b297-065af37f0e69 req-8396d9b0-64aa-45e3-8799-8c025d62be53 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:15.754459 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-11a71d95-01b2-4b33-b297-065af37f0e69 req-8396d9b0-64aa-45e3-8799-8c025d62be53 service nova] Creating event network-changed:a75edda5-2638-4320-afc1-42f9bdf0ed95 for instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 on hv-cinder-85694 Sep 13 07:05:15.759335 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-11a71d95-01b2-4b33-b297-065af37f0e69 req-8396d9b0-64aa-45e3-8799-8c025d62be53 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031918 Sep 13 07:05:15.760159 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 306/584] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:05:16.277609 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-601e0189-2acb-4e5d-a708-beafbf514977 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:05:16.280005 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-601e0189-2acb-4e5d-a708-beafbf514977 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:16.287054 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-601e0189-2acb-4e5d-a708-beafbf514977 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:16.287802 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-601e0189-2acb-4e5d-a708-beafbf514977 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:16.288208 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-601e0189-2acb-4e5d-a708-beafbf514977 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:16.288902 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-601e0189-2acb-4e5d-a708-beafbf514977 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:16.289543 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-601e0189-2acb-4e5d-a708-beafbf514977 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:16.289939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-601e0189-2acb-4e5d-a708-beafbf514977 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:16.317259 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-601e0189-2acb-4e5d-a708-beafbf514977 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lazy-loading 'flavor' on Instance uuid 8cd7bdba-2bb2-4f07-91d6-259c3af250e8 {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:05:16.438935 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:16.451253 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-601e0189-2acb-4e5d-a708-beafbf514977 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "POST /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8/action" status: 200 len: 32 microversion: 2.1 time: 0.177680 Sep 13 07:05:16.451895 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 279/585] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Sep 13 07:05:16 2022] POST /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 07:05:16.464713 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6ade2872-dacc-4412-a958-31c615145e4a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:16.466370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6ade2872-dacc-4412-a958-31c615145e4a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:16.475260 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ade2872-dacc-4412-a958-31c615145e4a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:16.476440 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ade2872-dacc-4412-a958-31c615145e4a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:16.477205 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ade2872-dacc-4412-a958-31c615145e4a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:16.478711 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ade2872-dacc-4412-a958-31c615145e4a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:16.479246 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ade2872-dacc-4412-a958-31c615145e4a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:16.479668 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ade2872-dacc-4412-a958-31c615145e4a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:16.678382 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6ade2872-dacc-4412-a958-31c615145e4a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:16.688450 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6ade2872-dacc-4412-a958-31c615145e4a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.228820 Sep 13 07:05:16.689116 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 307/586] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:16 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:17.718112 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-cb13f3d4-1145-454b-8ee4-f391520da543 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:17.719800 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-cb13f3d4-1145-454b-8ee4-f391520da543 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:17.726546 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cb13f3d4-1145-454b-8ee4-f391520da543 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:17.727033 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cb13f3d4-1145-454b-8ee4-f391520da543 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:17.727467 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cb13f3d4-1145-454b-8ee4-f391520da543 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:17.728155 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cb13f3d4-1145-454b-8ee4-f391520da543 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:17.728602 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cb13f3d4-1145-454b-8ee4-f391520da543 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:17.729024 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cb13f3d4-1145-454b-8ee4-f391520da543 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:17.870138 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-cb13f3d4-1145-454b-8ee4-f391520da543 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:17.878951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-cb13f3d4-1145-454b-8ee4-f391520da543 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.169812 Sep 13 07:05:17.879529 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 280/587] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:17 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:18.911530 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cad5d2a6-a9ba-4597-b58c-8f739e08e98e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:18.912309 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cad5d2a6-a9ba-4597-b58c-8f739e08e98e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:18.919107 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cad5d2a6-a9ba-4597-b58c-8f739e08e98e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:18.919589 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cad5d2a6-a9ba-4597-b58c-8f739e08e98e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:18.920020 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cad5d2a6-a9ba-4597-b58c-8f739e08e98e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:18.920710 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cad5d2a6-a9ba-4597-b58c-8f739e08e98e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:18.921153 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cad5d2a6-a9ba-4597-b58c-8f739e08e98e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:18.921571 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cad5d2a6-a9ba-4597-b58c-8f739e08e98e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:18.942295 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:19.085150 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cad5d2a6-a9ba-4597-b58c-8f739e08e98e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:19.095513 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cad5d2a6-a9ba-4597-b58c-8f739e08e98e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.187695 Sep 13 07:05:19.096413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 308/588] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:18 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:20.121778 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d734c97f-5208-409a-aea0-e546dd8ad00a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:20.122401 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d734c97f-5208-409a-aea0-e546dd8ad00a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:20.129464 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d734c97f-5208-409a-aea0-e546dd8ad00a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:20.129950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d734c97f-5208-409a-aea0-e546dd8ad00a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:20.130417 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d734c97f-5208-409a-aea0-e546dd8ad00a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:20.131124 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d734c97f-5208-409a-aea0-e546dd8ad00a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:20.131586 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d734c97f-5208-409a-aea0-e546dd8ad00a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:20.131994 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d734c97f-5208-409a-aea0-e546dd8ad00a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:20.267116 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d734c97f-5208-409a-aea0-e546dd8ad00a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:20.276183 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d734c97f-5208-409a-aea0-e546dd8ad00a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.158399 Sep 13 07:05:20.276766 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 281/589] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:20 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:21.302580 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-80c7ca25-4d33-4795-acd4-ef7e358f2e5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:21.303189 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-80c7ca25-4d33-4795-acd4-ef7e358f2e5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:21.311695 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-80c7ca25-4d33-4795-acd4-ef7e358f2e5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:21.312271 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-80c7ca25-4d33-4795-acd4-ef7e358f2e5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:21.312780 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-80c7ca25-4d33-4795-acd4-ef7e358f2e5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:21.313745 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-80c7ca25-4d33-4795-acd4-ef7e358f2e5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:21.314358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-80c7ca25-4d33-4795-acd4-ef7e358f2e5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:21.314864 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-80c7ca25-4d33-4795-acd4-ef7e358f2e5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:21.465810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-80c7ca25-4d33-4795-acd4-ef7e358f2e5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:21.474678 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-80c7ca25-4d33-4795-acd4-ef7e358f2e5e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.178261 Sep 13 07:05:21.475217 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 309/590] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:21 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:22.498262 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a5167afd-14b4-426b-a173-3c9f48a32338 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:22.498888 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a5167afd-14b4-426b-a173-3c9f48a32338 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:22.506190 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a5167afd-14b4-426b-a173-3c9f48a32338 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:22.506673 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a5167afd-14b4-426b-a173-3c9f48a32338 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:22.507089 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a5167afd-14b4-426b-a173-3c9f48a32338 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:22.507774 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a5167afd-14b4-426b-a173-3c9f48a32338 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:22.508215 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a5167afd-14b4-426b-a173-3c9f48a32338 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:22.508629 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a5167afd-14b4-426b-a173-3c9f48a32338 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:22.641444 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a5167afd-14b4-426b-a173-3c9f48a32338 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:22.650196 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a5167afd-14b4-426b-a173-3c9f48a32338 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.156198 Sep 13 07:05:22.650764 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 282/591] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:22 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:23.674307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fec529bf-8c21-405e-a1d4-44189e605aac tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:23.675090 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fec529bf-8c21-405e-a1d4-44189e605aac tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:23.682293 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fec529bf-8c21-405e-a1d4-44189e605aac tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:23.682773 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fec529bf-8c21-405e-a1d4-44189e605aac tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:23.683195 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fec529bf-8c21-405e-a1d4-44189e605aac tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:23.683885 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fec529bf-8c21-405e-a1d4-44189e605aac tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:23.684331 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fec529bf-8c21-405e-a1d4-44189e605aac tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:23.684743 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fec529bf-8c21-405e-a1d4-44189e605aac tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:23.819824 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fec529bf-8c21-405e-a1d4-44189e605aac tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:23.828206 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fec529bf-8c21-405e-a1d4-44189e605aac tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.158411 Sep 13 07:05:23.828773 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 310/592] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:23 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:05:24.856268 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a734cb39-9d65-40ec-a678-987f514ed238 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:24.857285 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a734cb39-9d65-40ec-a678-987f514ed238 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:24.872677 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a734cb39-9d65-40ec-a678-987f514ed238 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:24.873222 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a734cb39-9d65-40ec-a678-987f514ed238 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:24.873808 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a734cb39-9d65-40ec-a678-987f514ed238 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:24.874938 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a734cb39-9d65-40ec-a678-987f514ed238 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:24.875556 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a734cb39-9d65-40ec-a678-987f514ed238 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:24.876086 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a734cb39-9d65-40ec-a678-987f514ed238 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:25.021312 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a734cb39-9d65-40ec-a678-987f514ed238 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:25.029637 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a734cb39-9d65-40ec-a678-987f514ed238 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.180200 Sep 13 07:05:25.030230 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 283/593] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:24 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:26.057737 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-82af7324-4ddf-4739-af1d-8bea7a41b3b6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:26.058709 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-82af7324-4ddf-4739-af1d-8bea7a41b3b6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:26.068074 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82af7324-4ddf-4739-af1d-8bea7a41b3b6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:26.068566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82af7324-4ddf-4739-af1d-8bea7a41b3b6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:26.068995 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82af7324-4ddf-4739-af1d-8bea7a41b3b6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:26.069692 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82af7324-4ddf-4739-af1d-8bea7a41b3b6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:26.070129 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82af7324-4ddf-4739-af1d-8bea7a41b3b6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:26.070590 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82af7324-4ddf-4739-af1d-8bea7a41b3b6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:26.205504 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-82af7324-4ddf-4739-af1d-8bea7a41b3b6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:26.213887 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-82af7324-4ddf-4739-af1d-8bea7a41b3b6 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.163106 Sep 13 07:05:26.214595 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 311/594] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:26 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:27.238305 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-28b26c75-8dd1-4994-846d-ce9f48de3179 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:27.238835 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-28b26c75-8dd1-4994-846d-ce9f48de3179 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:27.241063 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=60 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:27.246444 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28b26c75-8dd1-4994-846d-ce9f48de3179 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:27.246923 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28b26c75-8dd1-4994-846d-ce9f48de3179 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:27.247354 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28b26c75-8dd1-4994-846d-ce9f48de3179 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:27.248058 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28b26c75-8dd1-4994-846d-ce9f48de3179 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:27.248491 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28b26c75-8dd1-4994-846d-ce9f48de3179 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:27.248912 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28b26c75-8dd1-4994-846d-ce9f48de3179 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:27.381348 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-28b26c75-8dd1-4994-846d-ce9f48de3179 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:27.390028 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-28b26c75-8dd1-4994-846d-ce9f48de3179 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.156062 Sep 13 07:05:27.390648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 284/595] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:27 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:28.419851 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6f40a404-51f3-4ed6-a3d3-0bd89f9d3c38 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:28.420842 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6f40a404-51f3-4ed6-a3d3-0bd89f9d3c38 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:28.424694 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:28.434794 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6f40a404-51f3-4ed6-a3d3-0bd89f9d3c38 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:28.435605 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6f40a404-51f3-4ed6-a3d3-0bd89f9d3c38 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:28.436327 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6f40a404-51f3-4ed6-a3d3-0bd89f9d3c38 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:28.437474 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6f40a404-51f3-4ed6-a3d3-0bd89f9d3c38 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:28.438268 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6f40a404-51f3-4ed6-a3d3-0bd89f9d3c38 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:28.438975 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6f40a404-51f3-4ed6-a3d3-0bd89f9d3c38 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:28.586830 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6f40a404-51f3-4ed6-a3d3-0bd89f9d3c38 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:28.595847 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6f40a404-51f3-4ed6-a3d3-0bd89f9d3c38 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.182606 Sep 13 07:05:28.596604 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 312/596] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:28 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:29.623910 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-15042e35-6d53-4fbe-a499-0e8742f398de tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:29.624805 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-15042e35-6d53-4fbe-a499-0e8742f398de tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:29.632768 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-15042e35-6d53-4fbe-a499-0e8742f398de tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:29.633245 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-15042e35-6d53-4fbe-a499-0e8742f398de tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:29.633695 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-15042e35-6d53-4fbe-a499-0e8742f398de tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:29.634394 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-15042e35-6d53-4fbe-a499-0e8742f398de tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:29.634839 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-15042e35-6d53-4fbe-a499-0e8742f398de tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:29.635250 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-15042e35-6d53-4fbe-a499-0e8742f398de tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:29.766395 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-15042e35-6d53-4fbe-a499-0e8742f398de tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:29.781203 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-15042e35-6d53-4fbe-a499-0e8742f398de tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.163381 Sep 13 07:05:29.782074 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 285/597] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:29 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:30.808950 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-99d7cf43-17da-4b8f-8509-1048a8681d93 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:30.809964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-99d7cf43-17da-4b8f-8509-1048a8681d93 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:30.821076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-99d7cf43-17da-4b8f-8509-1048a8681d93 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:30.821858 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-99d7cf43-17da-4b8f-8509-1048a8681d93 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:30.822617 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-99d7cf43-17da-4b8f-8509-1048a8681d93 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:30.823739 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-99d7cf43-17da-4b8f-8509-1048a8681d93 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:30.824482 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-99d7cf43-17da-4b8f-8509-1048a8681d93 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:30.825173 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-99d7cf43-17da-4b8f-8509-1048a8681d93 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:30.965758 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-99d7cf43-17da-4b8f-8509-1048a8681d93 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:30.974309 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-99d7cf43-17da-4b8f-8509-1048a8681d93 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.172358 Sep 13 07:05:30.974881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 313/598] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:30 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:31.998993 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d03551b5-fe67-4b12-b116-0a118c4ad93e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:31.999697 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d03551b5-fe67-4b12-b116-0a118c4ad93e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:32.007235 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d03551b5-fe67-4b12-b116-0a118c4ad93e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:32.007717 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d03551b5-fe67-4b12-b116-0a118c4ad93e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:32.008151 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d03551b5-fe67-4b12-b116-0a118c4ad93e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:32.008842 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d03551b5-fe67-4b12-b116-0a118c4ad93e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:32.009318 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d03551b5-fe67-4b12-b116-0a118c4ad93e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:32.009739 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d03551b5-fe67-4b12-b116-0a118c4ad93e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:32.144125 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d03551b5-fe67-4b12-b116-0a118c4ad93e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:32.152963 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d03551b5-fe67-4b12-b116-0a118c4ad93e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.158631 Sep 13 07:05:32.153551 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 286/599] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:31 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:33.180208 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-96e7502f-7b40-4df7-9021-b360a10ec43b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:33.181379 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-96e7502f-7b40-4df7-9021-b360a10ec43b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:33.190294 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96e7502f-7b40-4df7-9021-b360a10ec43b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:33.190931 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96e7502f-7b40-4df7-9021-b360a10ec43b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:33.191509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96e7502f-7b40-4df7-9021-b360a10ec43b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:33.192460 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96e7502f-7b40-4df7-9021-b360a10ec43b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:33.193069 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96e7502f-7b40-4df7-9021-b360a10ec43b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:33.193623 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96e7502f-7b40-4df7-9021-b360a10ec43b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:33.348408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-96e7502f-7b40-4df7-9021-b360a10ec43b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:33.356989 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-96e7502f-7b40-4df7-9021-b360a10ec43b tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.182152 Sep 13 07:05:33.357561 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 314/600] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:33 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:34.384194 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ec39e3e1-5a26-44a4-bef6-b9edfdee2295 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:34.385285 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ec39e3e1-5a26-44a4-bef6-b9edfdee2295 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:34.395836 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ec39e3e1-5a26-44a4-bef6-b9edfdee2295 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:34.396563 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ec39e3e1-5a26-44a4-bef6-b9edfdee2295 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:34.397220 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ec39e3e1-5a26-44a4-bef6-b9edfdee2295 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:34.398309 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ec39e3e1-5a26-44a4-bef6-b9edfdee2295 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:34.398998 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ec39e3e1-5a26-44a4-bef6-b9edfdee2295 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:34.399649 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ec39e3e1-5a26-44a4-bef6-b9edfdee2295 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:34.533171 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ec39e3e1-5a26-44a4-bef6-b9edfdee2295 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:34.541677 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ec39e3e1-5a26-44a4-bef6-b9edfdee2295 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.164101 Sep 13 07:05:34.542278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 287/601] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:34 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:35.569966 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4d70e1d5-df76-40bb-b72d-c9d700b938ea tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:35.570643 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4d70e1d5-df76-40bb-b72d-c9d700b938ea tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:35.577551 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4d70e1d5-df76-40bb-b72d-c9d700b938ea tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:35.578036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4d70e1d5-df76-40bb-b72d-c9d700b938ea tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:35.578491 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4d70e1d5-df76-40bb-b72d-c9d700b938ea tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:35.579182 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4d70e1d5-df76-40bb-b72d-c9d700b938ea tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:35.579630 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4d70e1d5-df76-40bb-b72d-c9d700b938ea tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:35.580058 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4d70e1d5-df76-40bb-b72d-c9d700b938ea tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:35.716145 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4d70e1d5-df76-40bb-b72d-c9d700b938ea tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:35.724882 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4d70e1d5-df76-40bb-b72d-c9d700b938ea tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.160149 Sep 13 07:05:35.725457 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 315/602] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:35 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:35.976183 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a934ec65-d820-4dfe-89cb-4b0861914c48 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:35.977167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a934ec65-d820-4dfe-89cb-4b0861914c48 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:35.987823 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a934ec65-d820-4dfe-89cb-4b0861914c48 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:35.988599 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a934ec65-d820-4dfe-89cb-4b0861914c48 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:35.989312 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a934ec65-d820-4dfe-89cb-4b0861914c48 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:35.990676 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a934ec65-d820-4dfe-89cb-4b0861914c48 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:35.991215 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a934ec65-d820-4dfe-89cb-4b0861914c48 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:35.991634 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a934ec65-d820-4dfe-89cb-4b0861914c48 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:36.024013 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a934ec65-d820-4dfe-89cb-4b0861914c48 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad/os-volume_attachments/f4a9ee8e-5ad9-4628-804d-2785e552e047" status: 200 len: 194 microversion: 2.20 time: 0.056157 Sep 13 07:05:36.024581 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 288/603] 10.222.0.25 () {60 vars in 1454 bytes} [Tue Sep 13 07:05:35 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad/os-volume_attachments/f4a9ee8e-5ad9-4628-804d-2785e552e047 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:05:36.102825 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-20d014d6-3ef6-40d8-a723-4614a29a27b8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:36.103301 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-20d014d6-3ef6-40d8-a723-4614a29a27b8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:36.109406 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-20d014d6-3ef6-40d8-a723-4614a29a27b8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:36.109872 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-20d014d6-3ef6-40d8-a723-4614a29a27b8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:36.110336 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-20d014d6-3ef6-40d8-a723-4614a29a27b8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:36.111000 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-20d014d6-3ef6-40d8-a723-4614a29a27b8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:36.111459 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-20d014d6-3ef6-40d8-a723-4614a29a27b8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:36.111844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-20d014d6-3ef6-40d8-a723-4614a29a27b8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:36.195410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-20d014d6-3ef6-40d8-a723-4614a29a27b8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lazy-loading 'services' on Instance uuid 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:05:36.278943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-20d014d6-3ef6-40d8-a723-4614a29a27b8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad/os-volume_attachments/f4a9ee8e-5ad9-4628-804d-2785e552e047" status: 202 len: 0 microversion: 2.20 time: 0.179947 Sep 13 07:05:36.279585 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 316/604] 10.222.0.25 () {60 vars in 1457 bytes} [Tue Sep 13 07:05:36 2022] DELETE /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad/os-volume_attachments/f4a9ee8e-5ad9-4628-804d-2785e552e047 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:05:36.288106 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9bd1e902-0d0a-499b-a6db-32c2096ce4b9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:36.290385 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9bd1e902-0d0a-499b-a6db-32c2096ce4b9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:36.296444 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bd1e902-0d0a-499b-a6db-32c2096ce4b9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:36.296926 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bd1e902-0d0a-499b-a6db-32c2096ce4b9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:36.297356 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bd1e902-0d0a-499b-a6db-32c2096ce4b9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:36.298053 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bd1e902-0d0a-499b-a6db-32c2096ce4b9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:36.298540 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bd1e902-0d0a-499b-a6db-32c2096ce4b9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:36.298963 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bd1e902-0d0a-499b-a6db-32c2096ce4b9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:36.329582 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9bd1e902-0d0a-499b-a6db-32c2096ce4b9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045502 Sep 13 07:05:36.335073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 289/605] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Sep 13 07:05:36 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:05:36.754054 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c9bdaa89-8909-4671-92c3-84cdb3d1fe41 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:36.755190 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c9bdaa89-8909-4671-92c3-84cdb3d1fe41 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:36.766734 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c9bdaa89-8909-4671-92c3-84cdb3d1fe41 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:36.767524 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c9bdaa89-8909-4671-92c3-84cdb3d1fe41 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:36.768232 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c9bdaa89-8909-4671-92c3-84cdb3d1fe41 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:36.769358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c9bdaa89-8909-4671-92c3-84cdb3d1fe41 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:36.770138 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c9bdaa89-8909-4671-92c3-84cdb3d1fe41 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:36.770854 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c9bdaa89-8909-4671-92c3-84cdb3d1fe41 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:36.916008 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c9bdaa89-8909-4671-92c3-84cdb3d1fe41 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:36.928571 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c9bdaa89-8909-4671-92c3-84cdb3d1fe41 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.182508 Sep 13 07:05:36.929182 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 317/606] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:36 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:37.347449 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e72d7130-8795-41ae-89d5-9127a06ec556 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:37.350781 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e72d7130-8795-41ae-89d5-9127a06ec556 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:37.358017 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e72d7130-8795-41ae-89d5-9127a06ec556 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:37.358520 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e72d7130-8795-41ae-89d5-9127a06ec556 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:37.358941 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e72d7130-8795-41ae-89d5-9127a06ec556 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:37.359630 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e72d7130-8795-41ae-89d5-9127a06ec556 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:37.360066 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e72d7130-8795-41ae-89d5-9127a06ec556 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:37.360481 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e72d7130-8795-41ae-89d5-9127a06ec556 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:37.390536 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e72d7130-8795-41ae-89d5-9127a06ec556 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049895 Sep 13 07:05:37.391075 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 290/607] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Sep 13 07:05:37 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:05:37.966455 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0a279d8d-2bf3-48ae-af5c-45072e16ce56 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:37.967451 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0a279d8d-2bf3-48ae-af5c-45072e16ce56 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:37.978226 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a279d8d-2bf3-48ae-af5c-45072e16ce56 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:37.978715 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a279d8d-2bf3-48ae-af5c-45072e16ce56 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:37.979141 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a279d8d-2bf3-48ae-af5c-45072e16ce56 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:37.979832 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a279d8d-2bf3-48ae-af5c-45072e16ce56 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:37.980280 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a279d8d-2bf3-48ae-af5c-45072e16ce56 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:37.980698 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a279d8d-2bf3-48ae-af5c-45072e16ce56 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:38.116519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0a279d8d-2bf3-48ae-af5c-45072e16ce56 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:38.128927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0a279d8d-2bf3-48ae-af5c-45072e16ce56 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.169589 Sep 13 07:05:38.129689 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 318/608] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:37 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:38.404351 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bf408192-9621-440c-9c16-b1c23485ad3e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:38.406722 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bf408192-9621-440c-9c16-b1c23485ad3e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:38.414294 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bf408192-9621-440c-9c16-b1c23485ad3e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:38.414792 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bf408192-9621-440c-9c16-b1c23485ad3e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:38.415221 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bf408192-9621-440c-9c16-b1c23485ad3e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:38.415919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bf408192-9621-440c-9c16-b1c23485ad3e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:38.416417 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bf408192-9621-440c-9c16-b1c23485ad3e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:38.416842 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bf408192-9621-440c-9c16-b1c23485ad3e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:38.447098 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bf408192-9621-440c-9c16-b1c23485ad3e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047177 Sep 13 07:05:38.447657 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 291/609] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Sep 13 07:05:38 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:38.515717 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-79a69695-683b-4d60-82e2-c73794dab4dc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:38.516205 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-79a69695-683b-4d60-82e2-c73794dab4dc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:38.523061 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79a69695-683b-4d60-82e2-c73794dab4dc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:38.523566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79a69695-683b-4d60-82e2-c73794dab4dc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:38.523975 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79a69695-683b-4d60-82e2-c73794dab4dc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:38.524664 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79a69695-683b-4d60-82e2-c73794dab4dc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:38.525107 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79a69695-683b-4d60-82e2-c73794dab4dc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:38.525524 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79a69695-683b-4d60-82e2-c73794dab4dc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:38.551046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-79a69695-683b-4d60-82e2-c73794dab4dc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:05:38.633936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-79a69695-683b-4d60-82e2-c73794dab4dc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 204 len: 0 microversion: 2.20 time: 0.121895 Sep 13 07:05:38.634653 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 319/610] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Sep 13 07:05:38 2022] DELETE /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 07:05:38.643358 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9d07e8e3-015b-484f-9c72-3a78ff105cdd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:38.643970 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9d07e8e3-015b-484f-9c72-3a78ff105cdd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:38.650197 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d07e8e3-015b-484f-9c72-3a78ff105cdd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:38.650683 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d07e8e3-015b-484f-9c72-3a78ff105cdd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:38.651110 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d07e8e3-015b-484f-9c72-3a78ff105cdd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:38.651802 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d07e8e3-015b-484f-9c72-3a78ff105cdd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:38.652250 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d07e8e3-015b-484f-9c72-3a78ff105cdd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:38.652669 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d07e8e3-015b-484f-9c72-3a78ff105cdd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:38.797788 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9d07e8e3-015b-484f-9c72-3a78ff105cdd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:38.806666 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9d07e8e3-015b-484f-9c72-3a78ff105cdd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:38.808096 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9d07e8e3-015b-484f-9c72-3a78ff105cdd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:38.809261 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9d07e8e3-015b-484f-9c72-3a78ff105cdd tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1723 microversion: 2.20 time: 0.170010 Sep 13 07:05:38.809791 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 292/611] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:05:38 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:05:39.157982 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4ca679d3-cfde-4b89-b659-853f0b0ac5af tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:39.159090 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4ca679d3-cfde-4b89-b659-853f0b0ac5af tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:39.168503 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ca679d3-cfde-4b89-b659-853f0b0ac5af tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:39.168980 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ca679d3-cfde-4b89-b659-853f0b0ac5af tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:39.169406 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ca679d3-cfde-4b89-b659-853f0b0ac5af tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:39.170108 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ca679d3-cfde-4b89-b659-853f0b0ac5af tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:39.170564 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ca679d3-cfde-4b89-b659-853f0b0ac5af tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:39.170988 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ca679d3-cfde-4b89-b659-853f0b0ac5af tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:39.310440 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4ca679d3-cfde-4b89-b659-853f0b0ac5af tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:39.319096 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4ca679d3-cfde-4b89-b659-853f0b0ac5af tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.168632 Sep 13 07:05:39.319666 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 320/612] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:39 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:39.838585 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6cb2053f-1d52-41f6-83fd-8f41280b7aea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:39.839198 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6cb2053f-1d52-41f6-83fd-8f41280b7aea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:39.847075 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6cb2053f-1d52-41f6-83fd-8f41280b7aea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:39.847553 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6cb2053f-1d52-41f6-83fd-8f41280b7aea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:39.847980 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6cb2053f-1d52-41f6-83fd-8f41280b7aea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:39.848667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6cb2053f-1d52-41f6-83fd-8f41280b7aea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:39.849108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6cb2053f-1d52-41f6-83fd-8f41280b7aea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:39.849521 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6cb2053f-1d52-41f6-83fd-8f41280b7aea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:39.993237 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6cb2053f-1d52-41f6-83fd-8f41280b7aea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:40.001722 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6cb2053f-1d52-41f6-83fd-8f41280b7aea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:40.003179 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6cb2053f-1d52-41f6-83fd-8f41280b7aea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:40.004346 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6cb2053f-1d52-41f6-83fd-8f41280b7aea tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1723 microversion: 2.20 time: 0.172614 Sep 13 07:05:40.004906 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 293/613] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:05:39 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:05:40.342909 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7a238ee6-3777-428b-ba5a-f51a8996727e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:40.343485 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7a238ee6-3777-428b-ba5a-f51a8996727e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:40.350107 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7a238ee6-3777-428b-ba5a-f51a8996727e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:40.350640 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7a238ee6-3777-428b-ba5a-f51a8996727e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:40.351061 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7a238ee6-3777-428b-ba5a-f51a8996727e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:40.351737 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7a238ee6-3777-428b-ba5a-f51a8996727e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:40.352199 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7a238ee6-3777-428b-ba5a-f51a8996727e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:40.352703 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7a238ee6-3777-428b-ba5a-f51a8996727e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:40.493998 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7a238ee6-3777-428b-ba5a-f51a8996727e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:40.506679 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7a238ee6-3777-428b-ba5a-f51a8996727e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.167455 Sep 13 07:05:40.507429 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 321/614] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:40 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:41.033620 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8894c4da-a1b3-4d77-94e5-13ea16b3195b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:41.034572 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8894c4da-a1b3-4d77-94e5-13ea16b3195b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:41.045058 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8894c4da-a1b3-4d77-94e5-13ea16b3195b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:41.045797 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8894c4da-a1b3-4d77-94e5-13ea16b3195b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:41.046782 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8894c4da-a1b3-4d77-94e5-13ea16b3195b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:41.047841 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8894c4da-a1b3-4d77-94e5-13ea16b3195b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:41.048532 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8894c4da-a1b3-4d77-94e5-13ea16b3195b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:41.049181 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8894c4da-a1b3-4d77-94e5-13ea16b3195b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:41.211025 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8894c4da-a1b3-4d77-94e5-13ea16b3195b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:41.219434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8894c4da-a1b3-4d77-94e5-13ea16b3195b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:41.220872 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8894c4da-a1b3-4d77-94e5-13ea16b3195b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:41.222069 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8894c4da-a1b3-4d77-94e5-13ea16b3195b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1723 microversion: 2.20 time: 0.194597 Sep 13 07:05:41.222660 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 294/615] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:05:41 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:05:41.531172 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6b9e41f7-1a65-4fac-a29e-0f8799ee593a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:41.532414 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6b9e41f7-1a65-4fac-a29e-0f8799ee593a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:41.541033 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b9e41f7-1a65-4fac-a29e-0f8799ee593a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:41.541519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b9e41f7-1a65-4fac-a29e-0f8799ee593a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:41.541967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b9e41f7-1a65-4fac-a29e-0f8799ee593a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:41.542717 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b9e41f7-1a65-4fac-a29e-0f8799ee593a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:41.543335 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b9e41f7-1a65-4fac-a29e-0f8799ee593a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:41.543762 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b9e41f7-1a65-4fac-a29e-0f8799ee593a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:41.675475 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6b9e41f7-1a65-4fac-a29e-0f8799ee593a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:41.679098 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:41.685896 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6b9e41f7-1a65-4fac-a29e-0f8799ee593a tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1733 microversion: 2.1 time: 0.158681 Sep 13 07:05:41.686614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 322/616] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:41 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:42.248239 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-507d0da8-93b6-473e-ae66-b0c3ac483fa6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:42.248856 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-507d0da8-93b6-473e-ae66-b0c3ac483fa6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:42.256047 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-507d0da8-93b6-473e-ae66-b0c3ac483fa6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:42.256539 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-507d0da8-93b6-473e-ae66-b0c3ac483fa6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:42.256976 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-507d0da8-93b6-473e-ae66-b0c3ac483fa6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:42.257691 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-507d0da8-93b6-473e-ae66-b0c3ac483fa6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:42.258224 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-507d0da8-93b6-473e-ae66-b0c3ac483fa6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:42.258653 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-507d0da8-93b6-473e-ae66-b0c3ac483fa6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:42.330129 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-507d0da8-93b6-473e-ae66-b0c3ac483fa6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:42.346429 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-507d0da8-93b6-473e-ae66-b0c3ac483fa6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:42.347893 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-507d0da8-93b6-473e-ae66-b0c3ac483fa6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:42.349076 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-507d0da8-93b6-473e-ae66-b0c3ac483fa6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1656 microversion: 2.20 time: 0.104951 Sep 13 07:05:42.349681 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 295/617] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:05:42 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1656 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:05:42.596306 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-996a68c0-c4d8-4748-990f-69d16740bf0a req-0dfe049e-5462-4ed6-8990-a56229565cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d57882a-892f-4b45-a8ec-7b6f4b21b0ad", "name": "network-vif-deleted", "tag": "447e368f-71d6-49ce-be81-226ee22458f1"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:05:42.603924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-996a68c0-c4d8-4748-990f-69d16740bf0a req-0dfe049e-5462-4ed6-8990-a56229565cbc service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:42.604393 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-996a68c0-c4d8-4748-990f-69d16740bf0a req-0dfe049e-5462-4ed6-8990-a56229565cbc service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:42.604856 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-996a68c0-c4d8-4748-990f-69d16740bf0a req-0dfe049e-5462-4ed6-8990-a56229565cbc service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:42.618405 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-996a68c0-c4d8-4748-990f-69d16740bf0a req-0dfe049e-5462-4ed6-8990-a56229565cbc service nova] Creating event network-vif-deleted:447e368f-71d6-49ce-be81-226ee22458f1 for instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad on hv-cinder-85694 Sep 13 07:05:42.623531 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-996a68c0-c4d8-4748-990f-69d16740bf0a req-0dfe049e-5462-4ed6-8990-a56229565cbc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034370 Sep 13 07:05:42.624160 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 323/618] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:05:42.709642 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ed8008f2-b3bb-4484-ae5a-ff2c772d9730 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:42.710200 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ed8008f2-b3bb-4484-ae5a-ff2c772d9730 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:42.716978 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed8008f2-b3bb-4484-ae5a-ff2c772d9730 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:42.717469 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed8008f2-b3bb-4484-ae5a-ff2c772d9730 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:42.717906 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed8008f2-b3bb-4484-ae5a-ff2c772d9730 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:42.718804 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed8008f2-b3bb-4484-ae5a-ff2c772d9730 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:42.719265 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed8008f2-b3bb-4484-ae5a-ff2c772d9730 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:42.719688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed8008f2-b3bb-4484-ae5a-ff2c772d9730 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:42.739461 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=100 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:42.849891 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ed8008f2-b3bb-4484-ae5a-ff2c772d9730 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:42.858933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ed8008f2-b3bb-4484-ae5a-ff2c772d9730 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1713 microversion: 2.1 time: 0.153953 Sep 13 07:05:42.859706 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 296/619] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:42 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1713 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:42.974742 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f72c511c-45f3-4cbe-8d8e-ae1122fb79fd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:42.975349 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f72c511c-45f3-4cbe-8d8e-ae1122fb79fd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:42.982362 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f72c511c-45f3-4cbe-8d8e-ae1122fb79fd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:42.982884 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f72c511c-45f3-4cbe-8d8e-ae1122fb79fd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:42.983316 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f72c511c-45f3-4cbe-8d8e-ae1122fb79fd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:42.984011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f72c511c-45f3-4cbe-8d8e-ae1122fb79fd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:42.984463 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f72c511c-45f3-4cbe-8d8e-ae1122fb79fd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:42.984885 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f72c511c-45f3-4cbe-8d8e-ae1122fb79fd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:43.070927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-f72c511c-45f3-4cbe-8d8e-ae1122fb79fd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] HTTP exception thrown: Cannot 'detach_volume' instance 8cd7bdba-2bb2-4f07-91d6-259c3af250e8 while it is in vm_state rescued Sep 13 07:05:43.072646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f72c511c-45f3-4cbe-8d8e-ae1122fb79fd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Request method failure captured: Sep 13 07:05:43.072646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8/os-volume_attachments/eda4bfe5-b992-4ff0-8e2d-219a18e30ca8 HTTP/1.1 Sep 13 07:05:43.072646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:05:43.072646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:05:43.072646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:05:43.072646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:05:43.072646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:05:43.072646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:05:43.072646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:05:43.072646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:05:43.072646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICqyQRLq_Qa1Tuxe68eosGmwt0cfbE0QkaoApj_vZMNT1tVfE9Z1aCGGEvvN2J5jEsNGtKZpwqKXbs-2kDkDTvieMwn3svXsvAJgMxZJF1u4g7iovW_UVB6Z-NWEeEosMH3ZRZftb8qQnq25CtsFAl2rJIxNetNMQK-S7hv1WD2Jc6s Sep 13 07:05:43.072646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:05:43.072646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:05:43.072646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:05:43.072646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:05:43.072646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:05:43.072646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:05:43.072646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 38b6d7b146a34896bb8309e2c51348f8 Sep 13 07:05:43.072646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-806686784 Sep 13 07:05:43.072646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:05:43.072646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:05:43.076434 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b6d7b146a34896bb8309e2c51348f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b6d7b146a34896bb8309e2c51348f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b6d7b146a34896bb8309e2c51348f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b6d7b146a34896bb8309e2c51348f8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:05:43.076434 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-ServerRescueNegativeTestJSON-806686784 Sep 13 07:05:43.076434 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 38b6d7b146a34896bb8309e2c51348f8 Sep 13 07:05:43.076434 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-806686784 Sep 13 07:05:43.076434 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-ServerRescueNegativeTestJSON-806686784-project Sep 13 07:05:43.076434 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:05:43.076434 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:05:43.076434 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 0d8d0ff010c04d65b36ebe65c1cbbbfd Sep 13 07:05:43.076434 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-ServerRescueNegativeTestJSON-806686784-project Sep 13 07:05:43.076434 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:05:43.076434 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Cannot 'detach_volume' instance 8cd7bdba-2bb2-4f07-91d6-259c3af250e8 while it is in vm_state rescued Sep 13 07:05:43.077282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'server_id': '8cd7bdba-2bb2-4f07-91d6-259c3af250e8', 'id': 'eda4bfe5-b992-4ff0-8e2d-219a18e30ca8'} Sep 13 07:05:43.077282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:05:43.077282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:05:43.077282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 13 07:05:43.077282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 13 07:05:43.077282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 07:05:43.077282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 07:05:43.077282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 07:05:43.077282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 07:05:43.077282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8cd7bdba-2bb2-4f07-91d6-259c3af250e8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 13 07:05:43.077282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:05:43.077282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:05:43.077282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:05:43.077282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:05:43.077282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:05:43.077282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:05:43.077282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:05:43.077282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:05:43.077282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:05:43.077282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:05:43.078827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 13 07:05:43.078827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 07:05:43.078827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 07:05:43.078827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 07:05:43.078827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8cd7bdba-2bb2-4f07-91d6-259c3af250e8 while it is in vm_state rescued Sep 13 07:05:43.078827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:05:43.078827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:05:43.078827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:05:43.078827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:05:43.078827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:05:43.078827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:05:43.078827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:05:43.078827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:05:43.078827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8cd7bdba-2bb2-4f07-91d6-259c3af250e8 while it is in vm_state rescued Sep 13 07:05:43.078827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:05:43.078827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f72c511c-45f3-4cbe-8d8e-ae1122fb79fd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Returning 409 to user: Cannot 'detach_volume' instance 8cd7bdba-2bb2-4f07-91d6-259c3af250e8 while it is in vm_state rescued {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:05:43.079937 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f72c511c-45f3-4cbe-8d8e-ae1122fb79fd tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8/os-volume_attachments/eda4bfe5-b992-4ff0-8e2d-219a18e30ca8" status: 409 len: 152 microversion: 2.1 time: 0.104626 Sep 13 07:05:43.079937 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 324/620] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Sep 13 07:05:42 2022] DELETE /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8/os-volume_attachments/eda4bfe5-b992-4ff0-8e2d-219a18e30ca8 => generated 152 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 07:05:43.084092 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-eb66aaa0-2064-427d-b102-c64dae7de9f7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:05:43.084632 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-eb66aaa0-2064-427d-b102-c64dae7de9f7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:43.090744 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eb66aaa0-2064-427d-b102-c64dae7de9f7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:43.091198 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eb66aaa0-2064-427d-b102-c64dae7de9f7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:43.091631 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eb66aaa0-2064-427d-b102-c64dae7de9f7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:43.092333 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eb66aaa0-2064-427d-b102-c64dae7de9f7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:43.092795 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eb66aaa0-2064-427d-b102-c64dae7de9f7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:43.093205 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eb66aaa0-2064-427d-b102-c64dae7de9f7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:43.165239 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-eb66aaa0-2064-427d-b102-c64dae7de9f7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "POST /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8/action" status: 202 len: 0 microversion: 2.1 time: 0.084842 Sep 13 07:05:43.166068 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 297/621] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Sep 13 07:05:43 2022] POST /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:05:43.174580 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-17908196-e288-40de-99d7-1feaefdd95cb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:43.175191 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-17908196-e288-40de-99d7-1feaefdd95cb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:43.182228 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-17908196-e288-40de-99d7-1feaefdd95cb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:43.182710 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-17908196-e288-40de-99d7-1feaefdd95cb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:43.183197 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-17908196-e288-40de-99d7-1feaefdd95cb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:43.183978 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-17908196-e288-40de-99d7-1feaefdd95cb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:43.184707 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-17908196-e288-40de-99d7-1feaefdd95cb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:43.185279 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-17908196-e288-40de-99d7-1feaefdd95cb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:43.333874 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-17908196-e288-40de-99d7-1feaefdd95cb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:43.343525 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-17908196-e288-40de-99d7-1feaefdd95cb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1721 microversion: 2.1 time: 0.173158 Sep 13 07:05:43.344127 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 325/622] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:43 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:43.375968 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c65eb114-4e21-4162-91fb-819a2c95383e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:43.376744 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c65eb114-4e21-4162-91fb-819a2c95383e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:43.384131 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c65eb114-4e21-4162-91fb-819a2c95383e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:43.384752 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c65eb114-4e21-4162-91fb-819a2c95383e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:43.385184 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c65eb114-4e21-4162-91fb-819a2c95383e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:43.385911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c65eb114-4e21-4162-91fb-819a2c95383e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:43.386438 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c65eb114-4e21-4162-91fb-819a2c95383e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:43.386852 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c65eb114-4e21-4162-91fb-819a2c95383e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:43.420157 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c65eb114-4e21-4162-91fb-819a2c95383e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:43.420399 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c65eb114-4e21-4162-91fb-819a2c95383e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:43.420773 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c65eb114-4e21-4162-91fb-819a2c95383e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:43.421215 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-c65eb114-4e21-4162-91fb-819a2c95383e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lazy-loading 'fault' on Instance uuid 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:05:43.467380 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c65eb114-4e21-4162-91fb-819a2c95383e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:43.476469 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c65eb114-4e21-4162-91fb-819a2c95383e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:43.478130 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c65eb114-4e21-4162-91fb-819a2c95383e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:43.479318 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c65eb114-4e21-4162-91fb-819a2c95383e tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 200 len: 1371 microversion: 2.20 time: 0.108462 Sep 13 07:05:43.480107 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 298/623] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:05:43 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 1371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:05:44.366972 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e86253db-01ef-4809-9de6-f09be2250eda tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:44.368106 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e86253db-01ef-4809-9de6-f09be2250eda tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:44.374957 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e86253db-01ef-4809-9de6-f09be2250eda tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:44.375365 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e86253db-01ef-4809-9de6-f09be2250eda tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:44.375798 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e86253db-01ef-4809-9de6-f09be2250eda tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:44.376475 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e86253db-01ef-4809-9de6-f09be2250eda tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:44.376927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e86253db-01ef-4809-9de6-f09be2250eda tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:44.377342 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e86253db-01ef-4809-9de6-f09be2250eda tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:44.505072 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b144eef6-a9e5-4893-9ab6-2048060c1499 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:44.505807 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b144eef6-a9e5-4893-9ab6-2048060c1499 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:44.512223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e86253db-01ef-4809-9de6-f09be2250eda tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:44.512989 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b144eef6-a9e5-4893-9ab6-2048060c1499 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:44.513543 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b144eef6-a9e5-4893-9ab6-2048060c1499 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:44.514018 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b144eef6-a9e5-4893-9ab6-2048060c1499 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:44.514994 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b144eef6-a9e5-4893-9ab6-2048060c1499 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:44.515494 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b144eef6-a9e5-4893-9ab6-2048060c1499 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:44.516106 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b144eef6-a9e5-4893-9ab6-2048060c1499 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:44.521230 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e86253db-01ef-4809-9de6-f09be2250eda tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1721 microversion: 2.1 time: 0.158113 Sep 13 07:05:44.521785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 326/624] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:44 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:44.531193 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-b144eef6-a9e5-4893-9ab6-2048060c1499 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] HTTP exception thrown: Instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad could not be found. Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b144eef6-a9e5-4893-9ab6-2048060c1499 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Request method failure captured: Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad HTTP/1.1 Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICq4nTd-aP038JiwuFg33jx8Zk7jhj6pQ2uHYezLvQNbNAU1rjnXAozUQp1dlj-QzL553aRRBtIslmCnTBnRyJYkjVEQHKpiU0KHLfSG_Dgxp2NA1zEAGqZ7MgkhWZhiD8vMrNeFUYk5I87ul6gDudadpSCN3KhR5aCN6kOHIYz1e88 Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: 5d5ac5d4506943c48f4f7640d97f63c5 Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2011100246 Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:05:44.532861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:05:44.534543 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5d5ac5d4506943c48f4f7640d97f63c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d5ac5d4506943c48f4f7640d97f63c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d5ac5d4506943c48f4f7640d97f63c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5d5ac5d4506943c48f4f7640d97f63c5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:05:44.534543 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2011100246 Sep 13 07:05:44.534543 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 5d5ac5d4506943c48f4f7640d97f63c5 Sep 13 07:05:44.534543 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2011100246 Sep 13 07:05:44.534543 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeShelveTestJSON-2011100246-project Sep 13 07:05:44.534543 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:05:44.534543 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:05:44.534543 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: ecf2dfd9bbe54b3085e9638caf8ad044 Sep 13 07:05:44.534543 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2011100246-project Sep 13 07:05:44.534543 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:05:44.534543 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad could not be found. Sep 13 07:05:44.534543 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': '5d57882a-892f-4b45-a8ec-7b6f4b21b0ad'} Sep 13 07:05:44.535359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:05:44.535359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:05:44.535359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:05:44.535359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:05:44.535359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:05:44.535359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:05:44.535359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:05:44.535359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:05:44.535359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:05:44.535359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:05:44.535359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad could not be found. Sep 13 07:05:44.535359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:05:44.535359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:05:44.535359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:05:44.535359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:05:44.535359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:05:44.535359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:05:44.535359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:05:44.535359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:05:44.535359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:05:44.537071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:05:44.537071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:05:44.537071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:05:44.537071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:05:44.537071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:05:44.537071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:05:44.537071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:05:44.537071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad could not be found. Sep 13 07:05:44.537071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:05:44.537071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:05:44.537071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:05:44.537071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:05:44.537071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:05:44.537071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:05:44.537071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:05:44.537071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:05:44.537071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad could not be found. Sep 13 07:05:44.537071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:05:44.538539 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b144eef6-a9e5-4893-9ab6-2048060c1499 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Returning 404 to user: Instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:05:44.538539 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b144eef6-a9e5-4893-9ab6-2048060c1499 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 404 len: 111 microversion: 2.20 time: 0.033173 Sep 13 07:05:44.538539 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 299/625] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:05:44 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 07:05:44.543755 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6cc9787b-faf2-424d-ab31-3f7c8891bca8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '.version_select at 0x7f4c19573430>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:44.564785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6cc9787b-faf2-424d-ab31-3f7c8891bca8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-538596837" status: 204 len: 0 microversion: 2.20 time: 0.024920 Sep 13 07:05:44.565502 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 327/626] 10.222.0.25 () {60 vars in 1259 bytes} [Tue Sep 13 07:05:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-538596837 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 07:05:45.256463 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7b29d17b-5e1b-423e-bd9e-0b2631f567fc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Action: 'create', calling method: .version_select at 0x7f4c195b7af0>, body: {"keypair": {"name": "tempest-keypair-710260180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP13iIr/GKqeyAUxl2rbnhShGNK+hvGC6ELlmea6d7LOZ9nAUlYzpEHpJW4gBmkW6dSOxqLJXvRafpaDErJsfGbUWaV5r9Q5JIAvMjXO11qaGMLZ39svRmmSL22/BeFqOw=="}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:05:45.273105 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-7b29d17b-5e1b-423e-bd9e-0b2631f567fc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Getting quotas for project 5d5ac5d4506943c48f4f7640d97f63c5. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:05:45.277362 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-7b29d17b-5e1b-423e-bd9e-0b2631f567fc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Getting quotas for user ecf2dfd9bbe54b3085e9638caf8ad044 and project 5d5ac5d4506943c48f4f7640d97f63c5. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:05:45.302791 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7b29d17b-5e1b-423e-bd9e-0b2631f567fc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.050368 Sep 13 07:05:45.303377 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 300/627] 10.222.0.25 () {62 vars in 1200 bytes} [Tue Sep 13 07:05:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 07:05:45.545471 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9c65f479-b38a-4951-bd0e-a9773e829408 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:45.546073 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9c65f479-b38a-4951-bd0e-a9773e829408 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:45.553375 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c65f479-b38a-4951-bd0e-a9773e829408 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:45.553882 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c65f479-b38a-4951-bd0e-a9773e829408 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:45.554437 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c65f479-b38a-4951-bd0e-a9773e829408 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:45.555452 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c65f479-b38a-4951-bd0e-a9773e829408 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:45.556252 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c65f479-b38a-4951-bd0e-a9773e829408 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:45.557126 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c65f479-b38a-4951-bd0e-a9773e829408 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:45.706356 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9c65f479-b38a-4951-bd0e-a9773e829408 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:45.715941 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9c65f479-b38a-4951-bd0e-a9773e829408 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1721 microversion: 2.1 time: 0.174664 Sep 13 07:05:45.716628 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 328/628] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:45 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:46.652101 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2e1bdba5-7433-49c7-861a-1e916fe07ca8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1164429799", "imageRef": "19a6700e-e153-4bea-87aa-036bfccf0ecd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c3c52b2-50ca-4f89-8b20-12f54380722c"}], "security_groups": [{"name": "tempest-securitygroup--2011863075"}], "key_name": "tempest-keypair-710260180", "user_data": "}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:05:46.740185 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bebf2b4e-c10b-4f24-a051-ce7c817895b3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:46.740780 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bebf2b4e-c10b-4f24-a051-ce7c817895b3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:46.747593 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bebf2b4e-c10b-4f24-a051-ce7c817895b3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:46.748100 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bebf2b4e-c10b-4f24-a051-ce7c817895b3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:46.748513 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bebf2b4e-c10b-4f24-a051-ce7c817895b3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:46.749201 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bebf2b4e-c10b-4f24-a051-ce7c817895b3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:46.749643 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bebf2b4e-c10b-4f24-a051-ce7c817895b3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:46.750056 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bebf2b4e-c10b-4f24-a051-ce7c817895b3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:46.756956 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-2e1bdba5-7433-49c7-861a-1e916fe07ca8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] validate_networks() for [('4c3c52b2-50ca-4f89-8b20-12f54380722c', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:05:46.954124 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bebf2b4e-c10b-4f24-a051-ce7c817895b3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:46.963690 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bebf2b4e-c10b-4f24-a051-ce7c817895b3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1721 microversion: 2.1 time: 0.227322 Sep 13 07:05:46.964464 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 329/629] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:46 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:47.193218 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-2e1bdba5-7433-49c7-861a-1e916fe07ca8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:05:47.193921 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-2e1bdba5-7433-49c7-861a-1e916fe07ca8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:05:47.194745 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-2e1bdba5-7433-49c7-861a-1e916fe07ca8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:05:47.195403 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-2e1bdba5-7433-49c7-861a-1e916fe07ca8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:05:47.196126 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-2e1bdba5-7433-49c7-861a-1e916fe07ca8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:05:47.206118 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2e1bdba5-7433-49c7-861a-1e916fe07ca8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:47.206612 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2e1bdba5-7433-49c7-861a-1e916fe07ca8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:47.207040 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2e1bdba5-7433-49c7-861a-1e916fe07ca8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:47.207759 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2e1bdba5-7433-49c7-861a-1e916fe07ca8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:47.208210 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2e1bdba5-7433-49c7-861a-1e916fe07ca8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:47.208651 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2e1bdba5-7433-49c7-861a-1e916fe07ca8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:47.225368 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-2e1bdba5-7433-49c7-861a-1e916fe07ca8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Getting quotas for project 5d5ac5d4506943c48f4f7640d97f63c5. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:05:47.229732 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-2e1bdba5-7433-49c7-861a-1e916fe07ca8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Getting quotas for user ecf2dfd9bbe54b3085e9638caf8ad044 and project 5d5ac5d4506943c48f4f7640d97f63c5. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:05:47.241068 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2e1bdba5-7433-49c7-861a-1e916fe07ca8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:05:47.243459 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2e1bdba5-7433-49c7-861a-1e916fe07ca8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='19a6700e-e153-4bea-87aa-036bfccf0ecd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:05:47.290751 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2e1bdba5-7433-49c7-861a-1e916fe07ca8 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.643784 Sep 13 07:05:47.291422 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 301/630] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Sep 13 07:05:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 07:05:47.302912 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-970fbfdb-0d32-435d-9e4f-637a599eeeac tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:47.303708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-970fbfdb-0d32-435d-9e4f-637a599eeeac tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:47.359111 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-970fbfdb-0d32-435d-9e4f-637a599eeeac tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:47.366427 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-970fbfdb-0d32-435d-9e4f-637a599eeeac tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:47.367880 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-970fbfdb-0d32-435d-9e4f-637a599eeeac tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:47.369015 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-970fbfdb-0d32-435d-9e4f-637a599eeeac tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1281 microversion: 2.20 time: 0.070160 Sep 13 07:05:47.369543 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 330/631] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:05:47 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:05:47.987719 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d4f6e391-09fa-4d37-99e4-55c72675a69e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:47.988301 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d4f6e391-09fa-4d37-99e4-55c72675a69e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:47.996306 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d4f6e391-09fa-4d37-99e4-55c72675a69e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:47.997442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d4f6e391-09fa-4d37-99e4-55c72675a69e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:47.997861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d4f6e391-09fa-4d37-99e4-55c72675a69e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:47.998828 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d4f6e391-09fa-4d37-99e4-55c72675a69e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:47.999278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d4f6e391-09fa-4d37-99e4-55c72675a69e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:47.999695 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d4f6e391-09fa-4d37-99e4-55c72675a69e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:48.140989 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d4f6e391-09fa-4d37-99e4-55c72675a69e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:48.149940 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d4f6e391-09fa-4d37-99e4-55c72675a69e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1727 microversion: 2.1 time: 0.166937 Sep 13 07:05:48.150816 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 302/632] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:05:47 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:05:48.172882 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-04a5253d-dc47-4784-a998-9c147af8ad91 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:48.173366 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-04a5253d-dc47-4784-a998-9c147af8ad91 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:48.179925 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-04a5253d-dc47-4784-a998-9c147af8ad91 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:48.180427 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-04a5253d-dc47-4784-a998-9c147af8ad91 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:48.181200 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-04a5253d-dc47-4784-a998-9c147af8ad91 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:48.181919 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-04a5253d-dc47-4784-a998-9c147af8ad91 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:48.182369 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-04a5253d-dc47-4784-a998-9c147af8ad91 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:48.182787 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-04a5253d-dc47-4784-a998-9c147af8ad91 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:48.265358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-04a5253d-dc47-4784-a998-9c147af8ad91 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096369 Sep 13 07:05:48.266074 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 331/633] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Sep 13 07:05:48 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:05:48.394590 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f00c0bb8-1365-4e08-8069-10622eb1dbe4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:48.395205 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f00c0bb8-1365-4e08-8069-10622eb1dbe4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:48.401869 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f00c0bb8-1365-4e08-8069-10622eb1dbe4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:48.402432 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f00c0bb8-1365-4e08-8069-10622eb1dbe4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:48.402868 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f00c0bb8-1365-4e08-8069-10622eb1dbe4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:48.403581 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f00c0bb8-1365-4e08-8069-10622eb1dbe4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:48.404032 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f00c0bb8-1365-4e08-8069-10622eb1dbe4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:48.404467 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f00c0bb8-1365-4e08-8069-10622eb1dbe4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:48.649473 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f00c0bb8-1365-4e08-8069-10622eb1dbe4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:48.658456 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f00c0bb8-1365-4e08-8069-10622eb1dbe4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:48.659892 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f00c0bb8-1365-4e08-8069-10622eb1dbe4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:48.660976 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f00c0bb8-1365-4e08-8069-10622eb1dbe4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1333 microversion: 2.20 time: 0.270611 Sep 13 07:05:48.661803 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 303/634] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:05:48 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1333 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:05:49.456143 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-41f3fb94-2320-4844-bf5e-8fb3df13a881 req-0381d49f-cb47-43db-a735-8ef4159f7c7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd7bdba-2bb2-4f07-91d6-259c3af250e8", "tag": "e4be0638-9439-4862-aa49-a64acec3c3ee"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:05:49.467866 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-41f3fb94-2320-4844-bf5e-8fb3df13a881 req-0381d49f-cb47-43db-a735-8ef4159f7c7d service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:49.468637 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-41f3fb94-2320-4844-bf5e-8fb3df13a881 req-0381d49f-cb47-43db-a735-8ef4159f7c7d service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:49.469398 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-41f3fb94-2320-4844-bf5e-8fb3df13a881 req-0381d49f-cb47-43db-a735-8ef4159f7c7d service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:49.484081 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-41f3fb94-2320-4844-bf5e-8fb3df13a881 req-0381d49f-cb47-43db-a735-8ef4159f7c7d service nova] Creating event network-changed:e4be0638-9439-4862-aa49-a64acec3c3ee for instance 8cd7bdba-2bb2-4f07-91d6-259c3af250e8 on hv-cinder-85694 Sep 13 07:05:49.489390 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-41f3fb94-2320-4844-bf5e-8fb3df13a881 req-0381d49f-cb47-43db-a735-8ef4159f7c7d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037024 Sep 13 07:05:49.490690 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 332/635] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:05:49.691320 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-79fb8be7-d84c-4df8-8d82-4c1f80a81d7b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:49.692935 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-79fb8be7-d84c-4df8-8d82-4c1f80a81d7b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:49.701792 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79fb8be7-d84c-4df8-8d82-4c1f80a81d7b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:49.702755 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79fb8be7-d84c-4df8-8d82-4c1f80a81d7b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:49.703383 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79fb8be7-d84c-4df8-8d82-4c1f80a81d7b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:49.704267 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79fb8be7-d84c-4df8-8d82-4c1f80a81d7b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:49.704928 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79fb8be7-d84c-4df8-8d82-4c1f80a81d7b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:49.705499 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79fb8be7-d84c-4df8-8d82-4c1f80a81d7b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:49.944218 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-79fb8be7-d84c-4df8-8d82-4c1f80a81d7b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:49.959591 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-79fb8be7-d84c-4df8-8d82-4c1f80a81d7b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:49.961561 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-79fb8be7-d84c-4df8-8d82-4c1f80a81d7b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:49.964276 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-79fb8be7-d84c-4df8-8d82-4c1f80a81d7b tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1407 microversion: 2.20 time: 0.280041 Sep 13 07:05:49.965924 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 304/636] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:05:49 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:05:50.330469 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-e6e9adc5-d276-4018-bc4f-6cbec2f6a4a2 req-bfe03d49-f38c-4f91-8d60-d57b47829769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1166e7-c092-4bde-b87c-cb8aaa1918da", "tag": "dc830de4-1081-4c18-ada7-433d5588216c"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:05:50.355096 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e6e9adc5-d276-4018-bc4f-6cbec2f6a4a2 req-bfe03d49-f38c-4f91-8d60-d57b47829769 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:50.355096 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e6e9adc5-d276-4018-bc4f-6cbec2f6a4a2 req-bfe03d49-f38c-4f91-8d60-d57b47829769 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:50.355411 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e6e9adc5-d276-4018-bc4f-6cbec2f6a4a2 req-bfe03d49-f38c-4f91-8d60-d57b47829769 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:50.369159 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-e6e9adc5-d276-4018-bc4f-6cbec2f6a4a2 req-bfe03d49-f38c-4f91-8d60-d57b47829769 service nova] Creating event network-changed:dc830de4-1081-4c18-ada7-433d5588216c for instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da on hv-cinder-85694 Sep 13 07:05:50.374892 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-e6e9adc5-d276-4018-bc4f-6cbec2f6a4a2 req-bfe03d49-f38c-4f91-8d60-d57b47829769 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049772 Sep 13 07:05:50.375496 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 333/637] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:05:50.991967 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9ce9c0fe-a698-4064-bc30-364fc082edce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:50.992696 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9ce9c0fe-a698-4064-bc30-364fc082edce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:51.002426 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ce9c0fe-a698-4064-bc30-364fc082edce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:51.003074 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ce9c0fe-a698-4064-bc30-364fc082edce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:51.003729 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ce9c0fe-a698-4064-bc30-364fc082edce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:51.004805 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ce9c0fe-a698-4064-bc30-364fc082edce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:51.005436 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ce9c0fe-a698-4064-bc30-364fc082edce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:51.006056 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ce9c0fe-a698-4064-bc30-364fc082edce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:51.151518 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9ce9c0fe-a698-4064-bc30-364fc082edce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:51.163997 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9ce9c0fe-a698-4064-bc30-364fc082edce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:51.165940 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9ce9c0fe-a698-4064-bc30-364fc082edce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:51.167087 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9ce9c0fe-a698-4064-bc30-364fc082edce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1407 microversion: 2.20 time: 0.180651 Sep 13 07:05:51.167691 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 305/638] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:05:50 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:05:51.510564 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-f0b6a8ef-cf96-4a75-aefc-bfd9366a86a3 req-4f1894ab-6d83-491c-a956-85c87a9cb1ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd7bdba-2bb2-4f07-91d6-259c3af250e8", "tag": "e4be0638-9439-4862-aa49-a64acec3c3ee"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:05:51.524102 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-f0b6a8ef-cf96-4a75-aefc-bfd9366a86a3 req-4f1894ab-6d83-491c-a956-85c87a9cb1ff service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:51.524781 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-f0b6a8ef-cf96-4a75-aefc-bfd9366a86a3 req-4f1894ab-6d83-491c-a956-85c87a9cb1ff service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:51.525289 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-f0b6a8ef-cf96-4a75-aefc-bfd9366a86a3 req-4f1894ab-6d83-491c-a956-85c87a9cb1ff service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:51.536385 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-f0b6a8ef-cf96-4a75-aefc-bfd9366a86a3 req-4f1894ab-6d83-491c-a956-85c87a9cb1ff service nova] Creating event network-changed:e4be0638-9439-4862-aa49-a64acec3c3ee for instance 8cd7bdba-2bb2-4f07-91d6-259c3af250e8 on hv-cinder-85694 Sep 13 07:05:51.541394 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-f0b6a8ef-cf96-4a75-aefc-bfd9366a86a3 req-4f1894ab-6d83-491c-a956-85c87a9cb1ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037944 Sep 13 07:05:51.541981 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 334/639] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:05:52.192206 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-86524919-82be-4da0-ba79-851fca0f7373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:52.192810 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-86524919-82be-4da0-ba79-851fca0f7373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:52.199896 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-86524919-82be-4da0-ba79-851fca0f7373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:52.200501 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-86524919-82be-4da0-ba79-851fca0f7373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:52.200998 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-86524919-82be-4da0-ba79-851fca0f7373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:52.201758 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-86524919-82be-4da0-ba79-851fca0f7373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:52.202471 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-86524919-82be-4da0-ba79-851fca0f7373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:52.203766 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-86524919-82be-4da0-ba79-851fca0f7373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:52.410029 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-86524919-82be-4da0-ba79-851fca0f7373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:52.420208 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-86524919-82be-4da0-ba79-851fca0f7373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:52.421637 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-86524919-82be-4da0-ba79-851fca0f7373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:52.422905 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-86524919-82be-4da0-ba79-851fca0f7373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1407 microversion: 2.20 time: 0.234609 Sep 13 07:05:52.423656 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 306/640] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:05:52 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:05:53.450117 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-df5a3b35-f6e8-496c-801b-64cedac9f795 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:53.450823 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-df5a3b35-f6e8-496c-801b-64cedac9f795 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:53.457729 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df5a3b35-f6e8-496c-801b-64cedac9f795 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:53.458258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df5a3b35-f6e8-496c-801b-64cedac9f795 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:53.458696 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df5a3b35-f6e8-496c-801b-64cedac9f795 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:53.459399 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df5a3b35-f6e8-496c-801b-64cedac9f795 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:53.459853 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df5a3b35-f6e8-496c-801b-64cedac9f795 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:53.460272 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df5a3b35-f6e8-496c-801b-64cedac9f795 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:53.592481 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-df5a3b35-f6e8-496c-801b-64cedac9f795 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:53.603774 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-df5a3b35-f6e8-496c-801b-64cedac9f795 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:53.605385 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-df5a3b35-f6e8-496c-801b-64cedac9f795 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:53.606570 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-df5a3b35-f6e8-496c-801b-64cedac9f795 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1407 microversion: 2.20 time: 0.161638 Sep 13 07:05:53.608102 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 335/641] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:05:53 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:05:54.631749 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9e8c006e-97a2-4248-86ff-84558a26cb76 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:54.632324 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9e8c006e-97a2-4248-86ff-84558a26cb76 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:54.639399 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e8c006e-97a2-4248-86ff-84558a26cb76 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:54.639883 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e8c006e-97a2-4248-86ff-84558a26cb76 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:54.640318 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e8c006e-97a2-4248-86ff-84558a26cb76 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:54.641017 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e8c006e-97a2-4248-86ff-84558a26cb76 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:54.641470 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e8c006e-97a2-4248-86ff-84558a26cb76 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:54.641921 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e8c006e-97a2-4248-86ff-84558a26cb76 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:54.783762 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9e8c006e-97a2-4248-86ff-84558a26cb76 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:54.792398 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9e8c006e-97a2-4248-86ff-84558a26cb76 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:54.793827 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9e8c006e-97a2-4248-86ff-84558a26cb76 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:54.794978 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9e8c006e-97a2-4248-86ff-84558a26cb76 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1407 microversion: 2.20 time: 0.167306 Sep 13 07:05:54.795542 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 307/642] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:05:54 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:05:55.246336 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-caf44834-c509-4283-a04d-f8ff7271e625 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:55.247004 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-caf44834-c509-4283-a04d-f8ff7271e625 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:55.254730 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-caf44834-c509-4283-a04d-f8ff7271e625 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:55.255274 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-caf44834-c509-4283-a04d-f8ff7271e625 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:55.255753 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-caf44834-c509-4283-a04d-f8ff7271e625 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:55.256514 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-caf44834-c509-4283-a04d-f8ff7271e625 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:55.257011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-caf44834-c509-4283-a04d-f8ff7271e625 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:55.257479 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-caf44834-c509-4283-a04d-f8ff7271e625 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:55.285362 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-caf44834-c509-4283-a04d-f8ff7271e625 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1/ips" status: 200 len: 149 microversion: 2.1 time: 0.045183 Sep 13 07:05:55.285913 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 336/643] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Sep 13 07:05:55 2022] GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:05:55.535447 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-71bbf541-fa1e-4d90-bb22-be9d03cdd19b req-3a1bd163-a2b5-4f02-ae48-85101de59bcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1166e7-c092-4bde-b87c-cb8aaa1918da", "name": "network-vif-plugged", "status": "completed", "tag": "dc830de4-1081-4c18-ada7-433d5588216c"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:05:55.547162 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-71bbf541-fa1e-4d90-bb22-be9d03cdd19b req-3a1bd163-a2b5-4f02-ae48-85101de59bcf service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:55.547732 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-71bbf541-fa1e-4d90-bb22-be9d03cdd19b req-3a1bd163-a2b5-4f02-ae48-85101de59bcf service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:55.548550 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-71bbf541-fa1e-4d90-bb22-be9d03cdd19b req-3a1bd163-a2b5-4f02-ae48-85101de59bcf service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:55.565240 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-71bbf541-fa1e-4d90-bb22-be9d03cdd19b req-3a1bd163-a2b5-4f02-ae48-85101de59bcf service nova] Creating event network-vif-plugged:dc830de4-1081-4c18-ada7-433d5588216c for instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da on hv-cinder-85694 Sep 13 07:05:55.572673 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-71bbf541-fa1e-4d90-bb22-be9d03cdd19b req-3a1bd163-a2b5-4f02-ae48-85101de59bcf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043229 Sep 13 07:05:55.573583 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 308/644] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:05:55.820631 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-58745934-33e4-424c-a132-9cf8ddf40cd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:55.821230 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-58745934-33e4-424c-a132-9cf8ddf40cd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:55.827593 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-58745934-33e4-424c-a132-9cf8ddf40cd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:55.828154 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-58745934-33e4-424c-a132-9cf8ddf40cd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:55.828586 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-58745934-33e4-424c-a132-9cf8ddf40cd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:55.829279 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-58745934-33e4-424c-a132-9cf8ddf40cd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:55.829715 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-58745934-33e4-424c-a132-9cf8ddf40cd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:55.830253 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-58745934-33e4-424c-a132-9cf8ddf40cd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:55.986101 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-58745934-33e4-424c-a132-9cf8ddf40cd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:55.994752 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-58745934-33e4-424c-a132-9cf8ddf40cd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:55.996166 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-58745934-33e4-424c-a132-9cf8ddf40cd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:55.997311 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-58745934-33e4-424c-a132-9cf8ddf40cd2 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1407 microversion: 2.20 time: 0.180742 Sep 13 07:05:55.997847 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 337/645] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:05:55 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:05:56.667552 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3a620ba2-9af6-4c7a-8973-b5d471db7b40 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85fc77e7-3ffa-4e88-9239-4194014550d1"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:05:56.670001 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3a620ba2-9af6-4c7a-8973-b5d471db7b40 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:56.676748 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a620ba2-9af6-4c7a-8973-b5d471db7b40 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:56.677242 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a620ba2-9af6-4c7a-8973-b5d471db7b40 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:56.677675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a620ba2-9af6-4c7a-8973-b5d471db7b40 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:56.678412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a620ba2-9af6-4c7a-8973-b5d471db7b40 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:56.678888 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a620ba2-9af6-4c7a-8973-b5d471db7b40 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:56.679312 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a620ba2-9af6-4c7a-8973-b5d471db7b40 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:57.022909 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-38fdc979-ae9d-413f-8501-5a8eaa01eb85 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:57.023934 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-38fdc979-ae9d-413f-8501-5a8eaa01eb85 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:57.030794 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-38fdc979-ae9d-413f-8501-5a8eaa01eb85 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:57.031286 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-38fdc979-ae9d-413f-8501-5a8eaa01eb85 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:57.031811 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-38fdc979-ae9d-413f-8501-5a8eaa01eb85 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:57.032514 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-38fdc979-ae9d-413f-8501-5a8eaa01eb85 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:57.032970 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-38fdc979-ae9d-413f-8501-5a8eaa01eb85 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:57.033415 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-38fdc979-ae9d-413f-8501-5a8eaa01eb85 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:57.095398 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3a620ba2-9af6-4c7a-8973-b5d471db7b40 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "POST /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.432914 Sep 13 07:05:57.096017 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 309/646] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Sep 13 07:05:56 2022] POST /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1/os-volume_attachments => generated 194 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:05:57.176230 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-38fdc979-ae9d-413f-8501-5a8eaa01eb85 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:57.184947 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-38fdc979-ae9d-413f-8501-5a8eaa01eb85 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:57.186432 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-38fdc979-ae9d-413f-8501-5a8eaa01eb85 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:57.187548 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-38fdc979-ae9d-413f-8501-5a8eaa01eb85 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1407 microversion: 2.20 time: 0.168715 Sep 13 07:05:57.188108 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 338/647] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:05:57 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:05:58.210204 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:58.211108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=10 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:58.216198 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-cabc93fe-99c1-4a98-bd05-9d0c55c893d4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:58.216906 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-cabc93fe-99c1-4a98-bd05-9d0c55c893d4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:58.218785 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:58.225573 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cabc93fe-99c1-4a98-bd05-9d0c55c893d4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:58.226010 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cabc93fe-99c1-4a98-bd05-9d0c55c893d4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:58.226470 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cabc93fe-99c1-4a98-bd05-9d0c55c893d4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:58.227177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cabc93fe-99c1-4a98-bd05-9d0c55c893d4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:58.227633 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cabc93fe-99c1-4a98-bd05-9d0c55c893d4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:58.228061 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cabc93fe-99c1-4a98-bd05-9d0c55c893d4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:58.372315 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-cabc93fe-99c1-4a98-bd05-9d0c55c893d4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:58.380793 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-cabc93fe-99c1-4a98-bd05-9d0c55c893d4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:58.382326 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-cabc93fe-99c1-4a98-bd05-9d0c55c893d4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:05:58.383499 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-cabc93fe-99c1-4a98-bd05-9d0c55c893d4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1599 microversion: 2.20 time: 0.174862 Sep 13 07:05:58.384063 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 310/648] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:05:58 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:05:58.408095 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e81d5541-2327-4fab-b55c-9dc1eb935198 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:05:58.408717 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e81d5541-2327-4fab-b55c-9dc1eb935198 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:05:58.410660 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:58.417025 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e81d5541-2327-4fab-b55c-9dc1eb935198 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:58.417531 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e81d5541-2327-4fab-b55c-9dc1eb935198 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:58.417956 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e81d5541-2327-4fab-b55c-9dc1eb935198 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:58.418941 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e81d5541-2327-4fab-b55c-9dc1eb935198 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:58.419403 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e81d5541-2327-4fab-b55c-9dc1eb935198 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:58.419819 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e81d5541-2327-4fab-b55c-9dc1eb935198 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:58.510293 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e81d5541-2327-4fab-b55c-9dc1eb935198 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.105981 Sep 13 07:05:58.511161 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 339/649] 10.222.0.25 () {60 vars in 1316 bytes} [Tue Sep 13 07:05:58 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:05:59.723003 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-ebd4d0da-d3e3-4672-b9fa-b14fbcaaf4fe req-862c9151-ec69-47c6-9e98-9170de61df81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1166e7-c092-4bde-b87c-cb8aaa1918da", "tag": "dc830de4-1081-4c18-ada7-433d5588216c"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:05:59.733215 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-ebd4d0da-d3e3-4672-b9fa-b14fbcaaf4fe req-862c9151-ec69-47c6-9e98-9170de61df81 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:05:59.733768 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-ebd4d0da-d3e3-4672-b9fa-b14fbcaaf4fe req-862c9151-ec69-47c6-9e98-9170de61df81 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:05:59.734654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-ebd4d0da-d3e3-4672-b9fa-b14fbcaaf4fe req-862c9151-ec69-47c6-9e98-9170de61df81 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:05:59.747257 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-ebd4d0da-d3e3-4672-b9fa-b14fbcaaf4fe req-862c9151-ec69-47c6-9e98-9170de61df81 service nova] Creating event network-changed:dc830de4-1081-4c18-ada7-433d5588216c for instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da on hv-cinder-85694 Sep 13 07:05:59.752288 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-ebd4d0da-d3e3-4672-b9fa-b14fbcaaf4fe req-862c9151-ec69-47c6-9e98-9170de61df81 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034490 Sep 13 07:05:59.753258 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 311/650] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:06:05.758367 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6359369c-5d02-4c66-850e-a1ab7ae1e38c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85fc77e7-3ffa-4e88-9239-4194014550d1"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:06:05.761172 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6359369c-5d02-4c66-850e-a1ab7ae1e38c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:05.764193 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:05.770510 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6359369c-5d02-4c66-850e-a1ab7ae1e38c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:05.770988 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6359369c-5d02-4c66-850e-a1ab7ae1e38c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:05.771418 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6359369c-5d02-4c66-850e-a1ab7ae1e38c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:05.772111 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6359369c-5d02-4c66-850e-a1ab7ae1e38c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:05.772584 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6359369c-5d02-4c66-850e-a1ab7ae1e38c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:05.772999 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6359369c-5d02-4c66-850e-a1ab7ae1e38c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:05.975192 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-6359369c-5d02-4c66-850e-a1ab7ae1e38c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] HTTP exception thrown: Invalid volume: volume 85fc77e7-3ffa-4e88-9239-4194014550d1 is already attached to instances: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 Sep 13 07:06:05.976936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6359369c-5d02-4c66-850e-a1ab7ae1e38c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Request method failure captured: Sep 13 07:06:05.976936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: POST /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1/os-volume_attachments HTTP/1.1 Sep 13 07:06:05.976936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:06:05.976936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:06:05.976936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:06:05.976936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 74 Sep 13 07:06:05.976936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:06:05.976936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:06:05.976936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:06:05.976936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:06:05.976936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICqyV8ZDoWvOKN7yB2xTUSeGEw-19LbL5z3b7FCDIrTHuyvYi1pO573AgmLpQMkZe3-u2HyPkAvEThrpkgPF3Y3DpDsAGrmh9FoN2kYrWow6jJnFAoIJGNoEoe53GgBmZUC7q0mN4-e6vnmtsq8cJkNCfkZrjfSjeL4PS70F44wGPd0 Sep 13 07:06:05.976936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:06:05.976936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:06:05.976936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:06:05.976936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:06:05.976936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:06:05.976936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:06:05.976936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:06:05.976936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:06:05.976936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:06:05.976936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:06:05.978679 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8c7dc05c1c9d40b2bb0defc9dd157d6e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:06:05.978679 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:06:05.978679 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:06:05.978679 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:06:05.978679 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:06:05.978679 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:06:05.978679 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:06:05.978679 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 5a0fd7347cad41bc80f427f872cf78fa Sep 13 07:06:05.978679 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:06:05.978679 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Sep 13 07:06:05.978679 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {"volumeAttachment": {"volumeId": "85fc77e7-3ffa-4e88-9239-4194014550d1"}} Sep 13 07:06:05.978679 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:06:05.979566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Invalid volume: volume 85fc77e7-3ffa-4e88-9239-4194014550d1 is already attached to instances: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 Sep 13 07:06:05.979566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'server_id': '2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1', 'body': {'volumeAttachment': {'volumeId': '85fc77e7-3ffa-4e88-9239-4194014550d1'}}} Sep 13 07:06:05.979566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:06:05.979566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:06:05.979566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 07:06:05.979566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 07:06:05.979566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 07:06:05.979566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 07:06:05.979566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 07:06:05.979566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 07:06:05.979566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 07:06:05.979566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 07:06:05.979566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 07:06:05.979566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 07:06:05.979566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 85fc77e7-3ffa-4e88-9239-4194014550d1 is already attached to instances: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 Sep 13 07:06:05.979566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:06:05.979566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:06:05.979566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:06:05.979566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:06:05.980927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:06:05.980927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:06:05.980927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:06:05.980927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:06:05.980927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:06:05.980927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:06:05.980927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 07:06:05.980927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 07:06:05.980927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 07:06:05.980927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 07:06:05.980927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 07:06:05.980927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 07:06:05.980927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 07:06:05.980927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 07:06:05.980927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 85fc77e7-3ffa-4e88-9239-4194014550d1 is already attached to instances: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 Sep 13 07:06:05.980927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:06:05.980927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:06:05.980927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:06:05.980927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:06:05.980927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:06:05.982639 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:06:05.982639 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:06:05.982639 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:06:05.982639 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 85fc77e7-3ffa-4e88-9239-4194014550d1 is already attached to instances: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 Sep 13 07:06:05.982639 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:06:05.982639 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6359369c-5d02-4c66-850e-a1ab7ae1e38c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Returning 400 to user: Invalid volume: volume 85fc77e7-3ffa-4e88-9239-4194014550d1 is already attached to instances: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:06:05.982639 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6359369c-5d02-4c66-850e-a1ab7ae1e38c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "POST /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.227695 Sep 13 07:06:05.982639 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 340/651] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Sep 13 07:06:05 2022] POST /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1/os-volume_attachments => generated 174 bytes in 229 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 07:06:06.047696 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-33806c43-e122-48bd-9762-9e9b5d24deb4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:06.048303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-33806c43-e122-48bd-9762-9e9b5d24deb4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:06.056180 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-33806c43-e122-48bd-9762-9e9b5d24deb4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:06.056660 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-33806c43-e122-48bd-9762-9e9b5d24deb4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:06.057092 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-33806c43-e122-48bd-9762-9e9b5d24deb4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:06.057779 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-33806c43-e122-48bd-9762-9e9b5d24deb4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:06.058285 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-33806c43-e122-48bd-9762-9e9b5d24deb4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:06.058698 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-33806c43-e122-48bd-9762-9e9b5d24deb4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:06.247678 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-33806c43-e122-48bd-9762-9e9b5d24deb4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lazy-loading 'services' on Instance uuid 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:06:06.368224 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-33806c43-e122-48bd-9762-9e9b5d24deb4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1/os-volume_attachments/85fc77e7-3ffa-4e88-9239-4194014550d1" status: 202 len: 0 microversion: 2.1 time: 0.326470 Sep 13 07:06:06.368805 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 312/652] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Sep 13 07:06:06 2022] DELETE /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1/os-volume_attachments/85fc77e7-3ffa-4e88-9239-4194014550d1 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:06:06.377653 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-edc1fa8a-78eb-4cf2-9b90-68106e7451b5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:06.379967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-edc1fa8a-78eb-4cf2-9b90-68106e7451b5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:06.386698 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-edc1fa8a-78eb-4cf2-9b90-68106e7451b5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:06.387193 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-edc1fa8a-78eb-4cf2-9b90-68106e7451b5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:06.387644 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-edc1fa8a-78eb-4cf2-9b90-68106e7451b5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:06.388328 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-edc1fa8a-78eb-4cf2-9b90-68106e7451b5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:06.388782 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-edc1fa8a-78eb-4cf2-9b90-68106e7451b5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:06.389190 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-edc1fa8a-78eb-4cf2-9b90-68106e7451b5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:06.421080 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-edc1fa8a-78eb-4cf2-9b90-68106e7451b5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047540 Sep 13 07:06:06.421622 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 341/653] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Sep 13 07:06:06 2022] GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:06:07.435764 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-de6844b8-3859-495d-bdd3-67721841d557 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:07.439608 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-de6844b8-3859-495d-bdd3-67721841d557 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:07.447445 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de6844b8-3859-495d-bdd3-67721841d557 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:07.447945 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de6844b8-3859-495d-bdd3-67721841d557 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:07.448373 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de6844b8-3859-495d-bdd3-67721841d557 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:07.449052 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de6844b8-3859-495d-bdd3-67721841d557 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:07.449501 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de6844b8-3859-495d-bdd3-67721841d557 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:07.449969 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de6844b8-3859-495d-bdd3-67721841d557 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:07.471872 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:07.487043 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-de6844b8-3859-495d-bdd3-67721841d557 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056880 Sep 13 07:06:07.487600 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 313/654] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Sep 13 07:06:07 2022] GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 07:06:07.550467 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9c3c439d-44b7-42da-a113-bb27d3132a0e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:07.551042 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9c3c439d-44b7-42da-a113-bb27d3132a0e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:07.557821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c3c439d-44b7-42da-a113-bb27d3132a0e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:07.558327 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c3c439d-44b7-42da-a113-bb27d3132a0e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:07.558731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c3c439d-44b7-42da-a113-bb27d3132a0e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:07.559467 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c3c439d-44b7-42da-a113-bb27d3132a0e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:07.559906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c3c439d-44b7-42da-a113-bb27d3132a0e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:07.560346 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c3c439d-44b7-42da-a113-bb27d3132a0e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:07.584981 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9c3c439d-44b7-42da-a113-bb27d3132a0e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:06:07.665776 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9c3c439d-44b7-42da-a113-bb27d3132a0e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1" status: 204 len: 0 microversion: 2.1 time: 0.118845 Sep 13 07:06:07.666445 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 342/655] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:06:07 2022] DELETE /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:06:07.675743 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7f59eb71-b7dc-4f31-a85f-50595c529f3f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:07.676372 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7f59eb71-b7dc-4f31-a85f-50595c529f3f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:07.683520 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7f59eb71-b7dc-4f31-a85f-50595c529f3f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:07.684005 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7f59eb71-b7dc-4f31-a85f-50595c529f3f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:07.684432 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7f59eb71-b7dc-4f31-a85f-50595c529f3f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:07.685161 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7f59eb71-b7dc-4f31-a85f-50595c529f3f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:07.685608 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7f59eb71-b7dc-4f31-a85f-50595c529f3f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:07.686028 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7f59eb71-b7dc-4f31-a85f-50595c529f3f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:07.827688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7f59eb71-b7dc-4f31-a85f-50595c529f3f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:07.835634 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7f59eb71-b7dc-4f31-a85f-50595c529f3f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1" status: 200 len: 1681 microversion: 2.1 time: 0.164172 Sep 13 07:06:07.836198 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 314/656] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:07 2022] GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:08.865165 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-831741a8-708c-474f-b44e-7021454d85b2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:08.865869 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-831741a8-708c-474f-b44e-7021454d85b2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:08.876766 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-831741a8-708c-474f-b44e-7021454d85b2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:08.877392 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-831741a8-708c-474f-b44e-7021454d85b2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:08.877990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-831741a8-708c-474f-b44e-7021454d85b2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:08.879095 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-831741a8-708c-474f-b44e-7021454d85b2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:08.879746 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-831741a8-708c-474f-b44e-7021454d85b2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:08.880265 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-831741a8-708c-474f-b44e-7021454d85b2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:08.905410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:09.023803 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-831741a8-708c-474f-b44e-7021454d85b2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:09.032246 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-831741a8-708c-474f-b44e-7021454d85b2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1" status: 200 len: 1681 microversion: 2.1 time: 0.174951 Sep 13 07:06:09.032838 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 343/657] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:08 2022] GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:10.057310 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7a976b7a-687e-4cd0-b7a6-ccbdcff989da tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:10.057928 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7a976b7a-687e-4cd0-b7a6-ccbdcff989da tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:10.064530 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7a976b7a-687e-4cd0-b7a6-ccbdcff989da tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:10.065155 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7a976b7a-687e-4cd0-b7a6-ccbdcff989da tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:10.065822 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7a976b7a-687e-4cd0-b7a6-ccbdcff989da tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:10.068290 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7a976b7a-687e-4cd0-b7a6-ccbdcff989da tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:10.068913 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7a976b7a-687e-4cd0-b7a6-ccbdcff989da tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:10.069396 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7a976b7a-687e-4cd0-b7a6-ccbdcff989da tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:10.169316 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4e0a9c49-ac96-4332-b6ba-44c467ae2759 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1409586712"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:06:10.169930 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4e0a9c49-ac96-4332-b6ba-44c467ae2759 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:10.177502 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e0a9c49-ac96-4332-b6ba-44c467ae2759 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:10.178103 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e0a9c49-ac96-4332-b6ba-44c467ae2759 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:10.178530 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e0a9c49-ac96-4332-b6ba-44c467ae2759 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:10.179303 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e0a9c49-ac96-4332-b6ba-44c467ae2759 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:10.179741 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e0a9c49-ac96-4332-b6ba-44c467ae2759 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:10.180289 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e0a9c49-ac96-4332-b6ba-44c467ae2759 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:10.281235 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7a976b7a-687e-4cd0-b7a6-ccbdcff989da tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:10.289875 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7a976b7a-687e-4cd0-b7a6-ccbdcff989da tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1" status: 200 len: 1681 microversion: 2.1 time: 0.237655 Sep 13 07:06:10.290735 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 315/658] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:10 2022] GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 => generated 1681 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:10.442402 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.network.security_group_api [None req-4e0a9c49-ac96-4332-b6ba-44c467ae2759 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Removing security group 6df806b8-7689-403f-a1d7-a87499a7b12a from port 1e7460cd-303f-44c8-b234-3c2f83c1e238 Sep 13 07:06:11.085826 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-e14667e7-18c1-4aea-b26b-b183ada89c27 req-443f5200-64a8-404e-9d80-5acb4d3c35db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1", "name": "network-vif-deleted", "tag": "b05c2df1-d6ff-46f8-807a-b0bddae18565"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:06:11.101871 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-e14667e7-18c1-4aea-b26b-b183ada89c27 req-443f5200-64a8-404e-9d80-5acb4d3c35db service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:11.102399 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-e14667e7-18c1-4aea-b26b-b183ada89c27 req-443f5200-64a8-404e-9d80-5acb4d3c35db service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:11.102852 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-e14667e7-18c1-4aea-b26b-b183ada89c27 req-443f5200-64a8-404e-9d80-5acb4d3c35db service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:11.118473 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-e14667e7-18c1-4aea-b26b-b183ada89c27 req-443f5200-64a8-404e-9d80-5acb4d3c35db service nova] Creating event network-vif-deleted:b05c2df1-d6ff-46f8-807a-b0bddae18565 for instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 on hv-cinder-85694 Sep 13 07:06:11.133264 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-e14667e7-18c1-4aea-b26b-b183ada89c27 req-443f5200-64a8-404e-9d80-5acb4d3c35db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050972 Sep 13 07:06:11.133724 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 316/659] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:06:11.184877 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4e0a9c49-ac96-4332-b6ba-44c467ae2759 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "POST /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015/action" status: 202 len: 0 microversion: 2.1 time: 1.018530 Sep 13 07:06:11.184877 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 344/660] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Sep 13 07:06:10 2022] POST /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015/action => generated 0 bytes in 1020 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 07:06:11.315630 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c0d01c6e-1be4-4569-b57f-0b36e7c0f62e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:11.316624 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c0d01c6e-1be4-4569-b57f-0b36e7c0f62e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:11.335607 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c0d01c6e-1be4-4569-b57f-0b36e7c0f62e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:11.336527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c0d01c6e-1be4-4569-b57f-0b36e7c0f62e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:11.337519 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c0d01c6e-1be4-4569-b57f-0b36e7c0f62e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:11.338673 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c0d01c6e-1be4-4569-b57f-0b36e7c0f62e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:11.340081 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c0d01c6e-1be4-4569-b57f-0b36e7c0f62e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:11.341807 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c0d01c6e-1be4-4569-b57f-0b36e7c0f62e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:11.397331 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c0d01c6e-1be4-4569-b57f-0b36e7c0f62e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:11.397934 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c0d01c6e-1be4-4569-b57f-0b36e7c0f62e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:11.398455 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c0d01c6e-1be4-4569-b57f-0b36e7c0f62e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:11.399080 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-c0d01c6e-1be4-4569-b57f-0b36e7c0f62e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lazy-loading 'fault' on Instance uuid 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:06:11.502449 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c0d01c6e-1be4-4569-b57f-0b36e7c0f62e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:11.529213 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c0d01c6e-1be4-4569-b57f-0b36e7c0f62e tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1" status: 200 len: 1331 microversion: 2.1 time: 0.219790 Sep 13 07:06:11.529826 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 317/661] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:11 2022] GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 => generated 1331 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:12.433765 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-abbf0a9d-120b-46a9-8273-0bddb8d54781 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:12.434346 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-abbf0a9d-120b-46a9-8273-0bddb8d54781 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:12.440696 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-abbf0a9d-120b-46a9-8273-0bddb8d54781 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:12.441187 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-abbf0a9d-120b-46a9-8273-0bddb8d54781 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:12.441618 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-abbf0a9d-120b-46a9-8273-0bddb8d54781 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:12.442354 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-abbf0a9d-120b-46a9-8273-0bddb8d54781 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:12.442808 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-abbf0a9d-120b-46a9-8273-0bddb8d54781 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:12.443207 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-abbf0a9d-120b-46a9-8273-0bddb8d54781 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:12.527421 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-abbf0a9d-120b-46a9-8273-0bddb8d54781 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lazy-loading 'services' on Instance uuid 64680760-9370-4f3b-acc5-0ed7d1796015 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:06:12.553219 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ced06d65-3b83-47a2-990a-4ea63e3c7581 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:12.554050 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ced06d65-3b83-47a2-990a-4ea63e3c7581 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:12.561121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ced06d65-3b83-47a2-990a-4ea63e3c7581 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:12.561682 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ced06d65-3b83-47a2-990a-4ea63e3c7581 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:12.562250 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ced06d65-3b83-47a2-990a-4ea63e3c7581 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:12.563003 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ced06d65-3b83-47a2-990a-4ea63e3c7581 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:12.563508 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ced06d65-3b83-47a2-990a-4ea63e3c7581 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:12.563984 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ced06d65-3b83-47a2-990a-4ea63e3c7581 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:12.578932 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-ced06d65-3b83-47a2-990a-4ea63e3c7581 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] HTTP exception thrown: Instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 could not be found. Sep 13 07:06:12.580688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ced06d65-3b83-47a2-990a-4ea63e3c7581 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Request method failure captured: Sep 13 07:06:12.580688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 HTTP/1.1 Sep 13 07:06:12.580688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:06:12.580688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:06:12.580688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:06:12.580688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:06:12.580688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:06:12.580688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:06:12.580688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:06:12.580688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:06:12.580688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICqyV8ZDoWvOKN7yB2xTUSeGEw-19LbL5z3b7FCDIrTHuyvYi1pO573AgmLpQMkZe3-u2HyPkAvEThrpkgPF3Y3DpDsAGrmh9FoN2kYrWow6jJnFAoIJGNoEoe53GgBmZUC7q0mN4-e6vnmtsq8cJkNCfkZrjfSjeL4PS70F44wGPd0 Sep 13 07:06:12.580688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:06:12.580688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:06:12.580688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:06:12.580688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:06:12.580688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:06:12.580688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:06:12.580688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:06:12.580688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:06:12.580688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:06:12.580688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:06:12.582977 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8c7dc05c1c9d40b2bb0defc9dd157d6e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:06:12.582977 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:06:12.582977 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:06:12.582977 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:06:12.582977 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:06:12.582977 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:06:12.582977 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:06:12.582977 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: 5a0fd7347cad41bc80f427f872cf78fa Sep 13 07:06:12.582977 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:06:12.582977 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:06:12.582977 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 could not be found. Sep 13 07:06:12.582977 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': '2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1'} Sep 13 07:06:12.583882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:06:12.583882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:06:12.583882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:06:12.583882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:06:12.583882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:06:12.583882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:06:12.583882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:06:12.583882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:06:12.583882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:06:12.583882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:06:12.583882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 could not be found. Sep 13 07:06:12.583882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:06:12.583882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:06:12.583882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:06:12.583882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:06:12.583882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:06:12.583882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:06:12.583882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:06:12.583882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:06:12.583882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:06:12.585700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:06:12.585700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:06:12.585700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:06:12.585700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:06:12.585700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:06:12.585700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:06:12.585700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:06:12.585700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 could not be found. Sep 13 07:06:12.585700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:06:12.585700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:06:12.585700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:06:12.585700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:06:12.585700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:06:12.585700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:06:12.585700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:06:12.585700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:06:12.585700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 could not be found. Sep 13 07:06:12.585700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:06:12.588187 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ced06d65-3b83-47a2-990a-4ea63e3c7581 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Returning 404 to user: Instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:06:12.588187 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ced06d65-3b83-47a2-990a-4ea63e3c7581 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1" status: 404 len: 111 microversion: 2.1 time: 0.033993 Sep 13 07:06:12.588187 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 318/662] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:12 2022] GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:06:12.592416 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1aeb42f7-0344-442f-b43f-7c7d43f107b5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '.version_select at 0x7f4c1966e9d0>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:12.619056 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1aeb42f7-0344-442f-b43f-7c7d43f107b5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-635394839" status: 202 len: 0 microversion: 2.1 time: 0.030214 Sep 13 07:06:12.623018 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 319/663] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Sep 13 07:06:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-635394839 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:06:12.623171 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-abbf0a9d-120b-46a9-8273-0bddb8d54781 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "DELETE /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015/os-volume_attachments/9947bd7b-0a3d-468c-ba4a-f89f52c6f387" status: 202 len: 0 microversion: 2.1 time: 0.192405 Sep 13 07:06:12.623171 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 345/664] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Sep 13 07:06:12 2022] DELETE /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015/os-volume_attachments/9947bd7b-0a3d-468c-ba4a-f89f52c6f387 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:06:12.630932 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-64916e2b-626e-4119-83c7-28756f8a6bf8 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:12.633362 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-64916e2b-626e-4119-83c7-28756f8a6bf8 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:12.640717 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64916e2b-626e-4119-83c7-28756f8a6bf8 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:12.640952 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64916e2b-626e-4119-83c7-28756f8a6bf8 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:12.641704 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64916e2b-626e-4119-83c7-28756f8a6bf8 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:12.642070 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64916e2b-626e-4119-83c7-28756f8a6bf8 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:12.642561 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64916e2b-626e-4119-83c7-28756f8a6bf8 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:12.643034 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64916e2b-626e-4119-83c7-28756f8a6bf8 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:12.674826 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-64916e2b-626e-4119-83c7-28756f8a6bf8 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048209 Sep 13 07:06:12.675868 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 320/665] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Sep 13 07:06:12 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:06:13.149545 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-6d2a43c3-2067-4158-a10b-e2a36f412a7f req-33e60215-cc10-4102-9792-e93d58e1da03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64680760-9370-4f3b-acc5-0ed7d1796015", "tag": "1e7460cd-303f-44c8-b234-3c2f83c1e238"}, {"name": "network-changed", "server_uuid": "64680760-9370-4f3b-acc5-0ed7d1796015", "tag": "1e7460cd-303f-44c8-b234-3c2f83c1e238"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:06:13.163536 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-6d2a43c3-2067-4158-a10b-e2a36f412a7f req-33e60215-cc10-4102-9792-e93d58e1da03 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:13.164013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-6d2a43c3-2067-4158-a10b-e2a36f412a7f req-33e60215-cc10-4102-9792-e93d58e1da03 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:13.164431 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-6d2a43c3-2067-4158-a10b-e2a36f412a7f req-33e60215-cc10-4102-9792-e93d58e1da03 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:13.177860 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-6d2a43c3-2067-4158-a10b-e2a36f412a7f req-33e60215-cc10-4102-9792-e93d58e1da03 service nova] Creating event network-changed:1e7460cd-303f-44c8-b234-3c2f83c1e238 for instance 64680760-9370-4f3b-acc5-0ed7d1796015 on hv-cinder-85694 Sep 13 07:06:13.178358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-6d2a43c3-2067-4158-a10b-e2a36f412a7f req-33e60215-cc10-4102-9792-e93d58e1da03 service nova] Creating event network-changed:1e7460cd-303f-44c8-b234-3c2f83c1e238 for instance 64680760-9370-4f3b-acc5-0ed7d1796015 on hv-cinder-85694 Sep 13 07:06:13.184660 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-6d2a43c3-2067-4158-a10b-e2a36f412a7f req-33e60215-cc10-4102-9792-e93d58e1da03 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039350 Sep 13 07:06:13.185751 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 346/666] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:06:13.290805 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-84d88dbb-560a-4cc7-96e6-6f8369507a08 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Action: 'create', calling method: .version_select at 0x7f4c1953c700>, body: {"keypair": {"name": "tempest-keypair-242755384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6FdtW6LbfurYpPGsVSQ0GHhh+TtFvokYLheVgKqPs7GGNygHjeKE9dmucWElxrFObGUBgRuRO+U5YBK3voHFKq/DjmZmexbe/8r2ka0Ea0xn6vI8fHDKQJynSxrHr3Qg=="}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:06:13.307193 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-84d88dbb-560a-4cc7-96e6-6f8369507a08 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Getting quotas for project 8c7dc05c1c9d40b2bb0defc9dd157d6e. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:06:13.311238 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-84d88dbb-560a-4cc7-96e6-6f8369507a08 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Getting quotas for user 5a0fd7347cad41bc80f427f872cf78fa and project 8c7dc05c1c9d40b2bb0defc9dd157d6e. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:06:13.336919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-84d88dbb-560a-4cc7-96e6-6f8369507a08 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049903 Sep 13 07:06:13.337919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 321/667] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Sep 13 07:06:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:06:13.689806 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-380e3469-2806-4b80-b38d-d916432603af tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:13.692765 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-380e3469-2806-4b80-b38d-d916432603af tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:13.699244 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-380e3469-2806-4b80-b38d-d916432603af tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:13.699932 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-380e3469-2806-4b80-b38d-d916432603af tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:13.700535 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-380e3469-2806-4b80-b38d-d916432603af tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:13.702306 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-380e3469-2806-4b80-b38d-d916432603af tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:13.703049 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-380e3469-2806-4b80-b38d-d916432603af tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:13.703616 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-380e3469-2806-4b80-b38d-d916432603af tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:13.740447 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-380e3469-2806-4b80-b38d-d916432603af tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055743 Sep 13 07:06:13.741272 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 347/668] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Sep 13 07:06:13 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:06:14.797920 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-14af87ea-830d-4417-9b72-15debe1cf3e0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2105140673", "imageRef": "19a6700e-e153-4bea-87aa-036bfccf0ecd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "672f9e05-334a-4483-b823-bb14da4544d0"}], "security_groups": [{"name": "tempest-securitygroup--1103254350"}], "key_name": "tempest-keypair-242755384", "user_data": "}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:06:14.826281 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-39f88434-c9f9-4056-af25-4d7292938457 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:14.828463 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-39f88434-c9f9-4056-af25-4d7292938457 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:14.835628 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-39f88434-c9f9-4056-af25-4d7292938457 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:14.836117 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-39f88434-c9f9-4056-af25-4d7292938457 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:14.836561 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-39f88434-c9f9-4056-af25-4d7292938457 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:14.837258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-39f88434-c9f9-4056-af25-4d7292938457 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:14.837724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-39f88434-c9f9-4056-af25-4d7292938457 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:14.838230 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-39f88434-c9f9-4056-af25-4d7292938457 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:14.878612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-39f88434-c9f9-4056-af25-4d7292938457 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056300 Sep 13 07:06:14.879195 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 348/669] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Sep 13 07:06:14 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 07:06:14.889612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-74a209cd-8787-47fd-9311-6cb0c942712c tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:14.890116 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-74a209cd-8787-47fd-9311-6cb0c942712c tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:14.896571 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74a209cd-8787-47fd-9311-6cb0c942712c tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:14.897073 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74a209cd-8787-47fd-9311-6cb0c942712c tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:14.897497 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74a209cd-8787-47fd-9311-6cb0c942712c tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:14.898211 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74a209cd-8787-47fd-9311-6cb0c942712c tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:14.898663 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74a209cd-8787-47fd-9311-6cb0c942712c tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:14.899084 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74a209cd-8787-47fd-9311-6cb0c942712c tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:14.968311 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-14af87ea-830d-4417-9b72-15debe1cf3e0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] validate_networks() for [('672f9e05-334a-4483-b823-bb14da4544d0', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:06:14.976133 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-74a209cd-8787-47fd-9311-6cb0c942712c tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] HTTP exception thrown: Instance 64680760-9370-4f3b-acc5-0ed7d1796015 is not attached to volume 9947bd7b-0a3d-468c-ba4a-f89f52c6f387 Sep 13 07:06:14.984614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-74a209cd-8787-47fd-9311-6cb0c942712c tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Request method failure captured: Sep 13 07:06:14.984614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015/os-volume_attachments/9947bd7b-0a3d-468c-ba4a-f89f52c6f387 HTTP/1.1 Sep 13 07:06:14.984614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:06:14.984614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:06:14.984614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:06:14.984614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:06:14.984614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:06:14.984614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:06:14.984614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:06:14.984614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:06:14.984614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICsYiIYBl_Cplp0Az2x1a8hxwaOwihhyZWkPiXN2meR47jfrfnYY9MDzj0uNaSBEVXqx1kXJk6-uxaRQ3bfBaLE_GyfWn0YducnQYBFpA37E_uWj_HNMFLfPk9ExyZhn_PCLsA93hWoiosuVJA357-beRc9utyXYrCEM9JKBICqJMts Sep 13 07:06:14.984614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:06:14.984614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:06:14.984614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:06:14.984614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:06:14.984614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:06:14.984614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:06:14.984614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 76569a470885443abfbe4e14e9b2f505 Sep 13 07:06:14.984614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-TestMinimumBasicScenario-877453184 Sep 13 07:06:14.984614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:06:14.984614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:06:14.986305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/76569a470885443abfbe4e14e9b2f505"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76569a470885443abfbe4e14e9b2f505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76569a470885443abfbe4e14e9b2f505"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_76569a470885443abfbe4e14e9b2f505", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:06:14.986305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-TestMinimumBasicScenario-877453184 Sep 13 07:06:14.986305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 76569a470885443abfbe4e14e9b2f505 Sep 13 07:06:14.986305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-TestMinimumBasicScenario-877453184 Sep 13 07:06:14.986305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-TestMinimumBasicScenario-877453184-project Sep 13 07:06:14.986305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:06:14.986305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:06:14.986305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: baa15cc84259470f93afcfe23ef55c2f Sep 13 07:06:14.986305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-TestMinimumBasicScenario-877453184-project Sep 13 07:06:14.986305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:06:14.986305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance 64680760-9370-4f3b-acc5-0ed7d1796015 is not attached to volume 9947bd7b-0a3d-468c-ba4a-f89f52c6f387 Sep 13 07:06:14.987816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'server_id': '64680760-9370-4f3b-acc5-0ed7d1796015', 'id': '9947bd7b-0a3d-468c-ba4a-f89f52c6f387'} Sep 13 07:06:14.987816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:06:14.987816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:06:14.987816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 13 07:06:14.987816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 13 07:06:14.987816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 07:06:14.987816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 07:06:14.987816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 13 07:06:14.987816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 13 07:06:14.987816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9947bd7b-0a3d-468c-ba4a-f89f52c6f387. Sep 13 07:06:14.987816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:06:14.987816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:06:14.987816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:06:14.987816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:06:14.987816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:06:14.987816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:06:14.987816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:06:14.987816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:06:14.987816 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:06:14.988985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:06:14.988985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 13 07:06:14.988985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 07:06:14.988985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64680760-9370-4f3b-acc5-0ed7d1796015 is not attached to volume 9947bd7b-0a3d-468c-ba4a-f89f52c6f387 Sep 13 07:06:14.988985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:06:14.988985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:06:14.988985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:06:14.988985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:06:14.988985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:06:14.988985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:06:14.988985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:06:14.988985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:06:14.988985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64680760-9370-4f3b-acc5-0ed7d1796015 is not attached to volume 9947bd7b-0a3d-468c-ba4a-f89f52c6f387 Sep 13 07:06:14.988985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:06:14.988985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-74a209cd-8787-47fd-9311-6cb0c942712c tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Returning 404 to user: Instance 64680760-9370-4f3b-acc5-0ed7d1796015 is not attached to volume 9947bd7b-0a3d-468c-ba4a-f89f52c6f387 {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:06:14.989897 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-74a209cd-8787-47fd-9311-6cb0c942712c tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "DELETE /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015/os-volume_attachments/9947bd7b-0a3d-468c-ba4a-f89f52c6f387" status: 404 len: 154 microversion: 2.1 time: 0.100341 Sep 13 07:06:14.989897 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 349/670] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Sep 13 07:06:14 2022] DELETE /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015/os-volume_attachments/9947bd7b-0a3d-468c-ba4a-f89f52c6f387 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:06:15.412060 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-14af87ea-830d-4417-9b72-15debe1cf3e0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:06:15.412479 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-14af87ea-830d-4417-9b72-15debe1cf3e0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:06:15.412944 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-14af87ea-830d-4417-9b72-15debe1cf3e0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:06:15.413373 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-14af87ea-830d-4417-9b72-15debe1cf3e0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:06:15.413776 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-14af87ea-830d-4417-9b72-15debe1cf3e0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:06:15.422636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-14af87ea-830d-4417-9b72-15debe1cf3e0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:15.423117 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-14af87ea-830d-4417-9b72-15debe1cf3e0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:15.423547 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-14af87ea-830d-4417-9b72-15debe1cf3e0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:15.425010 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-14af87ea-830d-4417-9b72-15debe1cf3e0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:15.425467 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-14af87ea-830d-4417-9b72-15debe1cf3e0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:15.425888 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-14af87ea-830d-4417-9b72-15debe1cf3e0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:15.444239 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-14af87ea-830d-4417-9b72-15debe1cf3e0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Getting quotas for project 8c7dc05c1c9d40b2bb0defc9dd157d6e. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:06:15.448362 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-14af87ea-830d-4417-9b72-15debe1cf3e0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Getting quotas for user 5a0fd7347cad41bc80f427f872cf78fa and project 8c7dc05c1c9d40b2bb0defc9dd157d6e. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:06:15.460782 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-14af87ea-830d-4417-9b72-15debe1cf3e0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:06:15.463058 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-14af87ea-830d-4417-9b72-15debe1cf3e0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='19a6700e-e153-4bea-87aa-036bfccf0ecd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:06:15.514043 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-14af87ea-830d-4417-9b72-15debe1cf3e0 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.721689 Sep 13 07:06:15.514702 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 322/671] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Sep 13 07:06:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 07:06:15.526662 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-574084b1-b043-41c9-aa2f-93d1a30d55a4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:15.527270 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-574084b1-b043-41c9-aa2f-93d1a30d55a4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:15.587361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-574084b1-b043-41c9-aa2f-93d1a30d55a4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:15.594521 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-574084b1-b043-41c9-aa2f-93d1a30d55a4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1241 microversion: 2.1 time: 0.071689 Sep 13 07:06:15.595084 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 350/672] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:15 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:16.141322 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4874e466-dd5b-41bb-849b-1add22c09fff tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:16.141876 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4874e466-dd5b-41bb-849b-1add22c09fff tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:16.148202 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4874e466-dd5b-41bb-849b-1add22c09fff tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:16.148677 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4874e466-dd5b-41bb-849b-1add22c09fff tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:16.149276 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4874e466-dd5b-41bb-849b-1add22c09fff tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:16.150118 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4874e466-dd5b-41bb-849b-1add22c09fff tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:16.150796 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4874e466-dd5b-41bb-849b-1add22c09fff tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:16.151253 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4874e466-dd5b-41bb-849b-1add22c09fff tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:16.177362 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4874e466-dd5b-41bb-849b-1add22c09fff tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:06:16.259590 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4874e466-dd5b-41bb-849b-1add22c09fff tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "DELETE /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 204 len: 0 microversion: 2.1 time: 0.122497 Sep 13 07:06:16.260092 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 323/673] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:06:16 2022] DELETE /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:06:16.268684 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5069f89e-4dc3-406f-acdb-23dd67f34975 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:16.269351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5069f89e-4dc3-406f-acdb-23dd67f34975 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:16.276410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5069f89e-4dc3-406f-acdb-23dd67f34975 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:16.277261 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5069f89e-4dc3-406f-acdb-23dd67f34975 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:16.277693 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5069f89e-4dc3-406f-acdb-23dd67f34975 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:16.278858 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5069f89e-4dc3-406f-acdb-23dd67f34975 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:16.279452 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5069f89e-4dc3-406f-acdb-23dd67f34975 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:16.279925 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5069f89e-4dc3-406f-acdb-23dd67f34975 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:16.411065 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5069f89e-4dc3-406f-acdb-23dd67f34975 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:16.419391 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5069f89e-4dc3-406f-acdb-23dd67f34975 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1552 microversion: 2.1 time: 0.154804 Sep 13 07:06:16.419960 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 351/674] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:16 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:16.619523 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-334d887e-aecc-4d3b-9681-5b490071c025 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:16.620437 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-334d887e-aecc-4d3b-9681-5b490071c025 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:16.628104 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-334d887e-aecc-4d3b-9681-5b490071c025 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:16.628586 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-334d887e-aecc-4d3b-9681-5b490071c025 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:16.629022 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-334d887e-aecc-4d3b-9681-5b490071c025 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:16.629751 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-334d887e-aecc-4d3b-9681-5b490071c025 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:16.630232 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-334d887e-aecc-4d3b-9681-5b490071c025 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:16.630654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-334d887e-aecc-4d3b-9681-5b490071c025 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:16.697620 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-334d887e-aecc-4d3b-9681-5b490071c025 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:16.705965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-334d887e-aecc-4d3b-9681-5b490071c025 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1293 microversion: 2.1 time: 0.091861 Sep 13 07:06:16.706573 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 324/675] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:16 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:17.444437 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cb09467b-2dcf-4480-8d8f-f1941560d15b tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:17.445099 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cb09467b-2dcf-4480-8d8f-f1941560d15b tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:17.452291 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb09467b-2dcf-4480-8d8f-f1941560d15b tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:17.452774 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb09467b-2dcf-4480-8d8f-f1941560d15b tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:17.453221 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb09467b-2dcf-4480-8d8f-f1941560d15b tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:17.453941 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb09467b-2dcf-4480-8d8f-f1941560d15b tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:17.454452 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb09467b-2dcf-4480-8d8f-f1941560d15b tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:17.454890 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb09467b-2dcf-4480-8d8f-f1941560d15b tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:17.601225 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cb09467b-2dcf-4480-8d8f-f1941560d15b tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:17.609636 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cb09467b-2dcf-4480-8d8f-f1941560d15b tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1552 microversion: 2.1 time: 0.169950 Sep 13 07:06:17.610254 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 352/676] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:17 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1552 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:17.733422 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-af7ef6f6-933f-4e88-b176-f28caf0ca9e8 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:17.734321 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-af7ef6f6-933f-4e88-b176-f28caf0ca9e8 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:17.742617 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af7ef6f6-933f-4e88-b176-f28caf0ca9e8 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:17.743088 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af7ef6f6-933f-4e88-b176-f28caf0ca9e8 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:17.743515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af7ef6f6-933f-4e88-b176-f28caf0ca9e8 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:17.744194 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af7ef6f6-933f-4e88-b176-f28caf0ca9e8 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:17.744646 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af7ef6f6-933f-4e88-b176-f28caf0ca9e8 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:17.745067 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af7ef6f6-933f-4e88-b176-f28caf0ca9e8 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:17.810221 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-af7ef6f6-933f-4e88-b176-f28caf0ca9e8 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:17.818737 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-af7ef6f6-933f-4e88-b176-f28caf0ca9e8 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1293 microversion: 2.1 time: 0.091893 Sep 13 07:06:17.819325 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 325/677] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:17 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:18.632998 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-85f6f06d-f274-4560-99f0-1939dd40dd7f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:18.633585 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-85f6f06d-f274-4560-99f0-1939dd40dd7f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:18.640533 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85f6f06d-f274-4560-99f0-1939dd40dd7f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:18.641012 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85f6f06d-f274-4560-99f0-1939dd40dd7f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:18.641432 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85f6f06d-f274-4560-99f0-1939dd40dd7f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:18.642113 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85f6f06d-f274-4560-99f0-1939dd40dd7f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:18.642589 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85f6f06d-f274-4560-99f0-1939dd40dd7f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:18.642969 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85f6f06d-f274-4560-99f0-1939dd40dd7f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:18.731785 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-85f6f06d-f274-4560-99f0-1939dd40dd7f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:18.754073 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-85f6f06d-f274-4560-99f0-1939dd40dd7f tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1510 microversion: 2.1 time: 0.124883 Sep 13 07:06:18.754688 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 353/678] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:18 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1510 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:18.810667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-675ded7e-bd38-4f02-8276-f28f50568ba5 req-85b6a430-0464-483b-853c-a3f2e883a92f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64680760-9370-4f3b-acc5-0ed7d1796015", "name": "network-vif-deleted", "tag": "1e7460cd-303f-44c8-b234-3c2f83c1e238"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:06:18.821114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-675ded7e-bd38-4f02-8276-f28f50568ba5 req-85b6a430-0464-483b-853c-a3f2e883a92f service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:18.821839 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-675ded7e-bd38-4f02-8276-f28f50568ba5 req-85b6a430-0464-483b-853c-a3f2e883a92f service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:18.822447 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-675ded7e-bd38-4f02-8276-f28f50568ba5 req-85b6a430-0464-483b-853c-a3f2e883a92f service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:18.834021 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-675ded7e-bd38-4f02-8276-f28f50568ba5 req-85b6a430-0464-483b-853c-a3f2e883a92f service nova] Creating event network-vif-deleted:1e7460cd-303f-44c8-b234-3c2f83c1e238 for instance 64680760-9370-4f3b-acc5-0ed7d1796015 on hv-cinder-85694 Sep 13 07:06:18.839576 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-675ded7e-bd38-4f02-8276-f28f50568ba5 req-85b6a430-0464-483b-853c-a3f2e883a92f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032528 Sep 13 07:06:18.840195 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 326/679] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:06:18.843595 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1d09e5ac-4645-414b-b77b-4d3e6e7743ac tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:18.844298 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1d09e5ac-4645-414b-b77b-4d3e6e7743ac tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:18.851732 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1d09e5ac-4645-414b-b77b-4d3e6e7743ac tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:18.852411 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1d09e5ac-4645-414b-b77b-4d3e6e7743ac tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:18.852902 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1d09e5ac-4645-414b-b77b-4d3e6e7743ac tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:18.853592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1d09e5ac-4645-414b-b77b-4d3e6e7743ac tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:18.854121 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1d09e5ac-4645-414b-b77b-4d3e6e7743ac tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:18.854720 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1d09e5ac-4645-414b-b77b-4d3e6e7743ac tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:18.928523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1d09e5ac-4645-414b-b77b-4d3e6e7743ac tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:18.938276 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1d09e5ac-4645-414b-b77b-4d3e6e7743ac tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1301 microversion: 2.1 time: 0.099217 Sep 13 07:06:18.939463 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 354/680] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:18 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1301 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:19.779696 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-df099907-fdd0-47fe-be3e-7605c6a46b7a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:19.780953 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-df099907-fdd0-47fe-be3e-7605c6a46b7a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:19.789929 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df099907-fdd0-47fe-be3e-7605c6a46b7a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:19.790730 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df099907-fdd0-47fe-be3e-7605c6a46b7a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:19.796124 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df099907-fdd0-47fe-be3e-7605c6a46b7a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:19.796124 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df099907-fdd0-47fe-be3e-7605c6a46b7a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:19.796124 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df099907-fdd0-47fe-be3e-7605c6a46b7a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:19.796124 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df099907-fdd0-47fe-be3e-7605c6a46b7a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:19.839658 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df099907-fdd0-47fe-be3e-7605c6a46b7a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:19.840368 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df099907-fdd0-47fe-be3e-7605c6a46b7a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:19.840786 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df099907-fdd0-47fe-be3e-7605c6a46b7a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:19.841362 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-df099907-fdd0-47fe-be3e-7605c6a46b7a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lazy-loading 'fault' on Instance uuid 64680760-9370-4f3b-acc5-0ed7d1796015 {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:06:19.897212 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-df099907-fdd0-47fe-be3e-7605c6a46b7a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa15cc84259470f93afcfe23ef55c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76569a470885443abfbe4e14e9b2f505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:19.905516 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-df099907-fdd0-47fe-be3e-7605c6a46b7a tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 200 len: 1347 microversion: 2.1 time: 0.130634 Sep 13 07:06:19.906094 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 327/681] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:19 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 1347 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:19.961506 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2d97c8c4-d458-471a-bef9-f5699bb6c39b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:19.962222 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2d97c8c4-d458-471a-bef9-f5699bb6c39b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:19.968748 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d97c8c4-d458-471a-bef9-f5699bb6c39b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:19.969217 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d97c8c4-d458-471a-bef9-f5699bb6c39b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:19.969672 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d97c8c4-d458-471a-bef9-f5699bb6c39b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:19.970342 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d97c8c4-d458-471a-bef9-f5699bb6c39b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:19.970783 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d97c8c4-d458-471a-bef9-f5699bb6c39b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:19.971220 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d97c8c4-d458-471a-bef9-f5699bb6c39b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:20.149134 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2d97c8c4-d458-471a-bef9-f5699bb6c39b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:20.157544 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2d97c8c4-d458-471a-bef9-f5699bb6c39b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1367 microversion: 2.1 time: 0.199757 Sep 13 07:06:20.158179 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 355/682] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:19 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:20.866537 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-5bf26ef6-51ca-4489-822a-8893cd3872e5 req-31ab43da-b586-4f63-9a56-2ddc9474546e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e5c5ee-a0fa-47a6-9040-6f84ec08df56", "tag": "11a7948c-3f2b-4a5b-92c7-f59435f113d3"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:06:20.877025 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-5bf26ef6-51ca-4489-822a-8893cd3872e5 req-31ab43da-b586-4f63-9a56-2ddc9474546e service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:20.877528 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-5bf26ef6-51ca-4489-822a-8893cd3872e5 req-31ab43da-b586-4f63-9a56-2ddc9474546e service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:20.878318 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-5bf26ef6-51ca-4489-822a-8893cd3872e5 req-31ab43da-b586-4f63-9a56-2ddc9474546e service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:20.898619 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-5bf26ef6-51ca-4489-822a-8893cd3872e5 req-31ab43da-b586-4f63-9a56-2ddc9474546e service nova] Creating event network-changed:11a7948c-3f2b-4a5b-92c7-f59435f113d3 for instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 on hv-cinder-85694 Sep 13 07:06:20.904614 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-5bf26ef6-51ca-4489-822a-8893cd3872e5 req-31ab43da-b586-4f63-9a56-2ddc9474546e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043557 Sep 13 07:06:20.905220 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 328/683] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:06:20.931032 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ea362d50-112e-4320-b866-3d4d94b7b290 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:20.931558 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ea362d50-112e-4320-b866-3d4d94b7b290 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] [instance: 64680760-9370-4f3b-acc5-0ed7d1796015] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:20.938192 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea362d50-112e-4320-b866-3d4d94b7b290 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:20.938676 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea362d50-112e-4320-b866-3d4d94b7b290 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:20.939108 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea362d50-112e-4320-b866-3d4d94b7b290 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:20.939810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea362d50-112e-4320-b866-3d4d94b7b290 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:20.940254 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea362d50-112e-4320-b866-3d4d94b7b290 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:20.940692 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea362d50-112e-4320-b866-3d4d94b7b290 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:20.954872 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-ea362d50-112e-4320-b866-3d4d94b7b290 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] HTTP exception thrown: Instance 64680760-9370-4f3b-acc5-0ed7d1796015 could not be found. Sep 13 07:06:20.956625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ea362d50-112e-4320-b866-3d4d94b7b290 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Request method failure captured: Sep 13 07:06:20.956625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 HTTP/1.1 Sep 13 07:06:20.956625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:06:20.956625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:06:20.956625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:06:20.956625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:06:20.956625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:06:20.956625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:06:20.956625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:06:20.956625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:06:20.956625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICsYiIYBl_Cplp0Az2x1a8hxwaOwihhyZWkPiXN2meR47jfrfnYY9MDzj0uNaSBEVXqx1kXJk6-uxaRQ3bfBaLE_GyfWn0YducnQYBFpA37E_uWj_HNMFLfPk9ExyZhn_PCLsA93hWoiosuVJA357-beRc9utyXYrCEM9JKBICqJMts Sep 13 07:06:20.956625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:06:20.956625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:06:20.956625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:06:20.956625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:06:20.956625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:06:20.956625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:06:20.956625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 76569a470885443abfbe4e14e9b2f505 Sep 13 07:06:20.956625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-TestMinimumBasicScenario-877453184 Sep 13 07:06:20.956625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:06:20.956625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:06:20.958194 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/76569a470885443abfbe4e14e9b2f505"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76569a470885443abfbe4e14e9b2f505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76569a470885443abfbe4e14e9b2f505"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_76569a470885443abfbe4e14e9b2f505", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:06:20.958194 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-TestMinimumBasicScenario-877453184 Sep 13 07:06:20.958194 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 76569a470885443abfbe4e14e9b2f505 Sep 13 07:06:20.958194 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-TestMinimumBasicScenario-877453184 Sep 13 07:06:20.958194 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-TestMinimumBasicScenario-877453184-project Sep 13 07:06:20.958194 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:06:20.958194 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:06:20.958194 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: baa15cc84259470f93afcfe23ef55c2f Sep 13 07:06:20.958194 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-TestMinimumBasicScenario-877453184-project Sep 13 07:06:20.958194 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:06:20.958194 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance 64680760-9370-4f3b-acc5-0ed7d1796015 could not be found. Sep 13 07:06:20.958194 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': '64680760-9370-4f3b-acc5-0ed7d1796015'} Sep 13 07:06:20.963046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:06:20.963046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:06:20.963046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:06:20.963046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:06:20.963046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:06:20.963046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:06:20.963046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:06:20.963046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:06:20.963046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:06:20.963046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:06:20.963046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64680760-9370-4f3b-acc5-0ed7d1796015 could not be found. Sep 13 07:06:20.963046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:06:20.963046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:06:20.963046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:06:20.963046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:06:20.963046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:06:20.963046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:06:20.963046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:06:20.963046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:06:20.963046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:06:20.964985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:06:20.964985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:06:20.964985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:06:20.964985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:06:20.964985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:06:20.964985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:06:20.964985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:06:20.964985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64680760-9370-4f3b-acc5-0ed7d1796015 could not be found. Sep 13 07:06:20.964985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:06:20.964985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:06:20.964985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:06:20.964985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:06:20.964985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:06:20.964985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:06:20.964985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:06:20.964985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:06:20.964985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64680760-9370-4f3b-acc5-0ed7d1796015 could not be found. Sep 13 07:06:20.964985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:06:20.966336 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ea362d50-112e-4320-b866-3d4d94b7b290 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Returning 404 to user: Instance 64680760-9370-4f3b-acc5-0ed7d1796015 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:06:20.966336 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ea362d50-112e-4320-b866-3d4d94b7b290 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015" status: 404 len: 111 microversion: 2.1 time: 0.031591 Sep 13 07:06:20.966336 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 356/684] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:20 2022] GET /compute/v2.1/servers/64680760-9370-4f3b-acc5-0ed7d1796015 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:06:20.968724 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-06c0b45d-659b-4c6d-885a-15363d469df6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] Calling method '.version_select at 0x7f4c19574ca0>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:20.991549 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-06c0b45d-659b-4c6d-885a-15363d469df6 tempest-TestMinimumBasicScenario-877453184 tempest-TestMinimumBasicScenario-877453184-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-753796199" status: 202 len: 0 microversion: 2.1 time: 0.027654 Sep 13 07:06:20.992211 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 329/685] 10.222.0.25 () {58 vars in 1269 bytes} [Tue Sep 13 07:06:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-753796199 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:06:21.184074 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5d299b64-2713-4f51-b63b-995407d04b9b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:21.185457 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5d299b64-2713-4f51-b63b-995407d04b9b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:21.193182 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d299b64-2713-4f51-b63b-995407d04b9b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:21.202301 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d299b64-2713-4f51-b63b-995407d04b9b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:21.202743 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d299b64-2713-4f51-b63b-995407d04b9b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:21.203477 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d299b64-2713-4f51-b63b-995407d04b9b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:21.203944 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d299b64-2713-4f51-b63b-995407d04b9b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:21.204322 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d299b64-2713-4f51-b63b-995407d04b9b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:21.445332 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5d299b64-2713-4f51-b63b-995407d04b9b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:21.455655 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5d299b64-2713-4f51-b63b-995407d04b9b tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1367 microversion: 2.1 time: 0.276891 Sep 13 07:06:21.456730 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 357/686] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:21 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:22.483573 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-673556a3-7d6c-4ffa-bc3c-1a4f1f5b028a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:22.484298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-673556a3-7d6c-4ffa-bc3c-1a4f1f5b028a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:22.492108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-673556a3-7d6c-4ffa-bc3c-1a4f1f5b028a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:22.492582 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-673556a3-7d6c-4ffa-bc3c-1a4f1f5b028a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:22.493009 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-673556a3-7d6c-4ffa-bc3c-1a4f1f5b028a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:22.493696 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-673556a3-7d6c-4ffa-bc3c-1a4f1f5b028a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:22.494161 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-673556a3-7d6c-4ffa-bc3c-1a4f1f5b028a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:22.494579 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-673556a3-7d6c-4ffa-bc3c-1a4f1f5b028a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:22.677995 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-673556a3-7d6c-4ffa-bc3c-1a4f1f5b028a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:22.689816 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-673556a3-7d6c-4ffa-bc3c-1a4f1f5b028a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1367 microversion: 2.1 time: 0.209637 Sep 13 07:06:22.691445 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 330/687] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:22 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:23.713665 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b01986c4-0da2-4895-bb3d-a9435619232c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:23.715028 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b01986c4-0da2-4895-bb3d-a9435619232c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:23.725982 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b01986c4-0da2-4895-bb3d-a9435619232c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:23.727370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b01986c4-0da2-4895-bb3d-a9435619232c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:23.727965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b01986c4-0da2-4895-bb3d-a9435619232c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:23.729410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b01986c4-0da2-4895-bb3d-a9435619232c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:23.730019 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b01986c4-0da2-4895-bb3d-a9435619232c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:23.730618 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b01986c4-0da2-4895-bb3d-a9435619232c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:23.908378 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b01986c4-0da2-4895-bb3d-a9435619232c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:23.917232 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b01986c4-0da2-4895-bb3d-a9435619232c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1367 microversion: 2.1 time: 0.207510 Sep 13 07:06:23.918113 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 358/688] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:23 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:24.942616 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-48b12be6-cdfb-46c8-80cf-270fb6b86fa4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:24.943268 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-48b12be6-cdfb-46c8-80cf-270fb6b86fa4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:24.950404 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48b12be6-cdfb-46c8-80cf-270fb6b86fa4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:24.950665 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48b12be6-cdfb-46c8-80cf-270fb6b86fa4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:24.951095 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48b12be6-cdfb-46c8-80cf-270fb6b86fa4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:24.951790 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48b12be6-cdfb-46c8-80cf-270fb6b86fa4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:24.952304 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48b12be6-cdfb-46c8-80cf-270fb6b86fa4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:24.952710 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48b12be6-cdfb-46c8-80cf-270fb6b86fa4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:25.191995 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-48b12be6-cdfb-46c8-80cf-270fb6b86fa4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:25.200128 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-48b12be6-cdfb-46c8-80cf-270fb6b86fa4 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1367 microversion: 2.1 time: 0.262513 Sep 13 07:06:25.200805 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 331/689] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:24 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:25.665927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-a028f1e9-6d62-4b57-9356-b9d1eff1abdb req-bdedf36a-d984-46af-87f1-4aa95de91a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e5c5ee-a0fa-47a6-9040-6f84ec08df56", "name": "network-vif-plugged", "status": "completed", "tag": "11a7948c-3f2b-4a5b-92c7-f59435f113d3"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:06:25.674019 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:25.683870 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-a028f1e9-6d62-4b57-9356-b9d1eff1abdb req-bdedf36a-d984-46af-87f1-4aa95de91a4c service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:25.685797 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-a028f1e9-6d62-4b57-9356-b9d1eff1abdb req-bdedf36a-d984-46af-87f1-4aa95de91a4c service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:25.686483 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-a028f1e9-6d62-4b57-9356-b9d1eff1abdb req-bdedf36a-d984-46af-87f1-4aa95de91a4c service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:25.698414 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-a028f1e9-6d62-4b57-9356-b9d1eff1abdb req-bdedf36a-d984-46af-87f1-4aa95de91a4c service nova] Creating event network-vif-plugged:11a7948c-3f2b-4a5b-92c7-f59435f113d3 for instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 on hv-cinder-85694 Sep 13 07:06:25.703940 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-a028f1e9-6d62-4b57-9356-b9d1eff1abdb req-bdedf36a-d984-46af-87f1-4aa95de91a4c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042177 Sep 13 07:06:25.704561 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 359/690] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:06:26.223480 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c4d9af0a-3836-4c47-9c87-d5eb8e317813 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:26.224020 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c4d9af0a-3836-4c47-9c87-d5eb8e317813 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:26.226200 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:26.227269 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=10 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:26.234154 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c4d9af0a-3836-4c47-9c87-d5eb8e317813 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:26.234643 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c4d9af0a-3836-4c47-9c87-d5eb8e317813 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:26.235072 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c4d9af0a-3836-4c47-9c87-d5eb8e317813 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:26.235938 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c4d9af0a-3836-4c47-9c87-d5eb8e317813 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:26.236390 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c4d9af0a-3836-4c47-9c87-d5eb8e317813 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:26.236810 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c4d9af0a-3836-4c47-9c87-d5eb8e317813 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:26.680113 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c4d9af0a-3836-4c47-9c87-d5eb8e317813 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:26.688569 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c4d9af0a-3836-4c47-9c87-d5eb8e317813 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1367 microversion: 2.1 time: 0.469342 Sep 13 07:06:26.689129 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 332/691] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:26 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1367 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:27.408467 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e2f46060-1394-4e23-a222-6cd1f6be7dd0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:27.409820 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e2f46060-1394-4e23-a222-6cd1f6be7dd0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:27.417443 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e2f46060-1394-4e23-a222-6cd1f6be7dd0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:27.417924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e2f46060-1394-4e23-a222-6cd1f6be7dd0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:27.418382 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e2f46060-1394-4e23-a222-6cd1f6be7dd0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:27.419078 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e2f46060-1394-4e23-a222-6cd1f6be7dd0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:27.419526 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e2f46060-1394-4e23-a222-6cd1f6be7dd0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:27.419946 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e2f46060-1394-4e23-a222-6cd1f6be7dd0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:27.512050 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-e2f46060-1394-4e23-a222-6cd1f6be7dd0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lazy-loading 'services' on Instance uuid 8cd7bdba-2bb2-4f07-91d6-259c3af250e8 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:06:27.587279 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e2f46060-1394-4e23-a222-6cd1f6be7dd0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8/os-volume_attachments/eda4bfe5-b992-4ff0-8e2d-219a18e30ca8" status: 202 len: 0 microversion: 2.1 time: 0.185962 Sep 13 07:06:27.590121 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 360/692] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Sep 13 07:06:27 2022] DELETE /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8/os-volume_attachments/eda4bfe5-b992-4ff0-8e2d-219a18e30ca8 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:06:27.596613 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-fb19a1c8-8c06-4f79-9569-3164cc63bfcc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:27.599433 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-fb19a1c8-8c06-4f79-9569-3164cc63bfcc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:27.606336 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fb19a1c8-8c06-4f79-9569-3164cc63bfcc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:27.606677 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fb19a1c8-8c06-4f79-9569-3164cc63bfcc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:27.607159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fb19a1c8-8c06-4f79-9569-3164cc63bfcc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:27.607866 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fb19a1c8-8c06-4f79-9569-3164cc63bfcc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:27.608310 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fb19a1c8-8c06-4f79-9569-3164cc63bfcc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:27.608726 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fb19a1c8-8c06-4f79-9569-3164cc63bfcc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:27.649655 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-fb19a1c8-8c06-4f79-9569-3164cc63bfcc tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057119 Sep 13 07:06:27.650373 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 333/693] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Sep 13 07:06:27 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:06:27.713071 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f6bec5d8-55c7-45ba-a694-d5edb146d75c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:27.713900 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f6bec5d8-55c7-45ba-a694-d5edb146d75c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:27.720416 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6bec5d8-55c7-45ba-a694-d5edb146d75c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:27.720834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6bec5d8-55c7-45ba-a694-d5edb146d75c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:27.721261 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6bec5d8-55c7-45ba-a694-d5edb146d75c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:27.722181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6bec5d8-55c7-45ba-a694-d5edb146d75c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:27.723017 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6bec5d8-55c7-45ba-a694-d5edb146d75c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:27.723435 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6bec5d8-55c7-45ba-a694-d5edb146d75c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:27.957522 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f6bec5d8-55c7-45ba-a694-d5edb146d75c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:27.967105 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f6bec5d8-55c7-45ba-a694-d5edb146d75c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1367 microversion: 2.1 time: 0.258207 Sep 13 07:06:27.967924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 361/694] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:27 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:28.669473 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e34cd849-710e-479b-96eb-ed52b669987d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:28.669473 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e34cd849-710e-479b-96eb-ed52b669987d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:28.675321 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=2,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:28.677172 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e34cd849-710e-479b-96eb-ed52b669987d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:28.677654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e34cd849-710e-479b-96eb-ed52b669987d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:28.678193 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e34cd849-710e-479b-96eb-ed52b669987d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:28.679110 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e34cd849-710e-479b-96eb-ed52b669987d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:28.679560 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e34cd849-710e-479b-96eb-ed52b669987d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:28.679980 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e34cd849-710e-479b-96eb-ed52b669987d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:28.684895 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:28.718345 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e34cd849-710e-479b-96eb-ed52b669987d tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059572 Sep 13 07:06:28.718912 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 334/695] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Sep 13 07:06:28 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:06:28.991198 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cce0544d-2fc8-4b3a-a20c-2da3b86eceee tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:28.991872 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cce0544d-2fc8-4b3a-a20c-2da3b86eceee tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:28.998665 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce0544d-2fc8-4b3a-a20c-2da3b86eceee tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:28.999246 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce0544d-2fc8-4b3a-a20c-2da3b86eceee tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:28.999711 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce0544d-2fc8-4b3a-a20c-2da3b86eceee tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:29.000501 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce0544d-2fc8-4b3a-a20c-2da3b86eceee tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:29.001011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce0544d-2fc8-4b3a-a20c-2da3b86eceee tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:29.001498 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce0544d-2fc8-4b3a-a20c-2da3b86eceee tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:29.005960 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:29.136683 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cce0544d-2fc8-4b3a-a20c-2da3b86eceee tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:29.145244 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cce0544d-2fc8-4b3a-a20c-2da3b86eceee tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1556 microversion: 2.1 time: 0.158183 Sep 13 07:06:29.158811 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 362/696] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:28 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:29.169795 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-fc05d14e-8114-4d92-bd0e-ce6479f40f73 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:29.170394 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-fc05d14e-8114-4d92-bd0e-ce6479f40f73 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:29.177070 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fc05d14e-8114-4d92-bd0e-ce6479f40f73 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:29.177555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fc05d14e-8114-4d92-bd0e-ce6479f40f73 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:29.177988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fc05d14e-8114-4d92-bd0e-ce6479f40f73 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:29.178722 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fc05d14e-8114-4d92-bd0e-ce6479f40f73 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:29.179192 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fc05d14e-8114-4d92-bd0e-ce6479f40f73 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:29.179590 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fc05d14e-8114-4d92-bd0e-ce6479f40f73 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:29.265229 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-fc05d14e-8114-4d92-bd0e-ce6479f40f73 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099558 Sep 13 07:06:29.266151 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 335/697] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Sep 13 07:06:29 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:06:29.731036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-41c242ad-5ea6-46aa-8123-a9a96319420f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:29.733682 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-41c242ad-5ea6-46aa-8123-a9a96319420f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:29.741288 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41c242ad-5ea6-46aa-8123-a9a96319420f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:29.741872 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41c242ad-5ea6-46aa-8123-a9a96319420f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:29.742450 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41c242ad-5ea6-46aa-8123-a9a96319420f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:29.743392 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41c242ad-5ea6-46aa-8123-a9a96319420f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:29.743910 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41c242ad-5ea6-46aa-8123-a9a96319420f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:29.744397 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41c242ad-5ea6-46aa-8123-a9a96319420f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:29.778612 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-41c242ad-5ea6-46aa-8123-a9a96319420f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051616 Sep 13 07:06:29.785139 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 363/698] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Sep 13 07:06:29 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 07:06:29.905649 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2a9276f2-f228-4a12-92b4-1c485c011a50 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:29.906505 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2a9276f2-f228-4a12-92b4-1c485c011a50 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:29.913628 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2a9276f2-f228-4a12-92b4-1c485c011a50 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:29.914339 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2a9276f2-f228-4a12-92b4-1c485c011a50 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:29.914884 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2a9276f2-f228-4a12-92b4-1c485c011a50 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:29.915716 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2a9276f2-f228-4a12-92b4-1c485c011a50 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:29.916420 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2a9276f2-f228-4a12-92b4-1c485c011a50 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:29.916986 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2a9276f2-f228-4a12-92b4-1c485c011a50 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:29.946874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2a9276f2-f228-4a12-92b4-1c485c011a50 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:06:30.044474 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2a9276f2-f228-4a12-92b4-1c485c011a50 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 204 len: 0 microversion: 2.1 time: 0.151537 Sep 13 07:06:30.045324 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 336/699] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:06:29 2022] DELETE /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:06:30.056170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1aa68a93-080b-4f38-84cb-4fc0523a7b92 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:30.057735 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1aa68a93-080b-4f38-84cb-4fc0523a7b92 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:30.077929 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1aa68a93-080b-4f38-84cb-4fc0523a7b92 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:30.080641 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1aa68a93-080b-4f38-84cb-4fc0523a7b92 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:30.081482 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1aa68a93-080b-4f38-84cb-4fc0523a7b92 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:30.083996 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1aa68a93-080b-4f38-84cb-4fc0523a7b92 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:30.084756 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1aa68a93-080b-4f38-84cb-4fc0523a7b92 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:30.085447 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1aa68a93-080b-4f38-84cb-4fc0523a7b92 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:30.225605 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1aa68a93-080b-4f38-84cb-4fc0523a7b92 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:30.234441 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1aa68a93-080b-4f38-84cb-4fc0523a7b92 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1687 microversion: 2.1 time: 0.184692 Sep 13 07:06:30.235109 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 364/700] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:30 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1687 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:30.479126 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-af60289d-7c9c-4ecc-803e-4800d2204191 req-50418eda-df88-42d5-987a-7c0114c69904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e5c5ee-a0fa-47a6-9040-6f84ec08df56", "tag": "11a7948c-3f2b-4a5b-92c7-f59435f113d3"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:06:30.489180 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-af60289d-7c9c-4ecc-803e-4800d2204191 req-50418eda-df88-42d5-987a-7c0114c69904 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:30.489674 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-af60289d-7c9c-4ecc-803e-4800d2204191 req-50418eda-df88-42d5-987a-7c0114c69904 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:30.490066 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-af60289d-7c9c-4ecc-803e-4800d2204191 req-50418eda-df88-42d5-987a-7c0114c69904 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:30.501455 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-af60289d-7c9c-4ecc-803e-4800d2204191 req-50418eda-df88-42d5-987a-7c0114c69904 service nova] Creating event network-changed:11a7948c-3f2b-4a5b-92c7-f59435f113d3 for instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 on hv-cinder-85694 Sep 13 07:06:30.506612 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-af60289d-7c9c-4ecc-803e-4800d2204191 req-50418eda-df88-42d5-987a-7c0114c69904 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226589 Sep 13 07:06:30.507206 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 337/701] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:06:31.259098 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-da97d678-b45a-4152-94a3-b94c2732d022 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:31.259689 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-da97d678-b45a-4152-94a3-b94c2732d022 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:31.266531 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-da97d678-b45a-4152-94a3-b94c2732d022 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:31.267024 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-da97d678-b45a-4152-94a3-b94c2732d022 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:31.267427 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-da97d678-b45a-4152-94a3-b94c2732d022 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:31.268122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-da97d678-b45a-4152-94a3-b94c2732d022 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:31.268617 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-da97d678-b45a-4152-94a3-b94c2732d022 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:31.269074 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-da97d678-b45a-4152-94a3-b94c2732d022 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:31.405393 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-da97d678-b45a-4152-94a3-b94c2732d022 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:31.413666 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-da97d678-b45a-4152-94a3-b94c2732d022 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1687 microversion: 2.1 time: 0.158546 Sep 13 07:06:31.414378 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 365/702] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:31 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:32.443570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1a21a316-06a8-4b4c-b386-289c801bcf24 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:32.444724 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1a21a316-06a8-4b4c-b386-289c801bcf24 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:32.455373 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1a21a316-06a8-4b4c-b386-289c801bcf24 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:32.456387 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1a21a316-06a8-4b4c-b386-289c801bcf24 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:32.456870 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1a21a316-06a8-4b4c-b386-289c801bcf24 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:32.457668 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1a21a316-06a8-4b4c-b386-289c801bcf24 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:32.458236 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1a21a316-06a8-4b4c-b386-289c801bcf24 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:32.458638 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1a21a316-06a8-4b4c-b386-289c801bcf24 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:32.597534 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1a21a316-06a8-4b4c-b386-289c801bcf24 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:32.605779 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1a21a316-06a8-4b4c-b386-289c801bcf24 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1687 microversion: 2.1 time: 0.170341 Sep 13 07:06:32.606383 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 338/703] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:32 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:33.628980 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-25154069-6219-4e98-8a33-f739f9af2ad0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:33.631184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-25154069-6219-4e98-8a33-f739f9af2ad0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:33.638237 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25154069-6219-4e98-8a33-f739f9af2ad0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:33.638726 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25154069-6219-4e98-8a33-f739f9af2ad0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:33.639158 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25154069-6219-4e98-8a33-f739f9af2ad0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:33.639856 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25154069-6219-4e98-8a33-f739f9af2ad0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:33.640313 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25154069-6219-4e98-8a33-f739f9af2ad0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:33.640732 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25154069-6219-4e98-8a33-f739f9af2ad0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:33.858856 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-25154069-6219-4e98-8a33-f739f9af2ad0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:33.868263 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-25154069-6219-4e98-8a33-f739f9af2ad0 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1687 microversion: 2.1 time: 0.243196 Sep 13 07:06:33.869480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 366/704] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:33 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1687 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:34.442481 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-0c25cdf3-9260-4337-b9fd-4065e8dbf507 req-deba1835-6283-4ae1-a942-6584b166ec20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd7bdba-2bb2-4f07-91d6-259c3af250e8", "name": "network-vif-deleted", "tag": "e4be0638-9439-4862-aa49-a64acec3c3ee"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:06:34.452966 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-0c25cdf3-9260-4337-b9fd-4065e8dbf507 req-deba1835-6283-4ae1-a942-6584b166ec20 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:34.453361 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-0c25cdf3-9260-4337-b9fd-4065e8dbf507 req-deba1835-6283-4ae1-a942-6584b166ec20 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:34.454005 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-0c25cdf3-9260-4337-b9fd-4065e8dbf507 req-deba1835-6283-4ae1-a942-6584b166ec20 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:34.466059 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-0c25cdf3-9260-4337-b9fd-4065e8dbf507 req-deba1835-6283-4ae1-a942-6584b166ec20 service nova] Creating event network-vif-deleted:e4be0638-9439-4862-aa49-a64acec3c3ee for instance 8cd7bdba-2bb2-4f07-91d6-259c3af250e8 on hv-cinder-85694 Sep 13 07:06:34.471547 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-0c25cdf3-9260-4337-b9fd-4065e8dbf507 req-deba1835-6283-4ae1-a942-6584b166ec20 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032889 Sep 13 07:06:34.472836 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 339/705] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:06:34.892194 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6ff71447-a18e-479c-93ed-f14bc2cc7cb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:34.892858 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6ff71447-a18e-479c-93ed-f14bc2cc7cb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:34.899676 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ff71447-a18e-479c-93ed-f14bc2cc7cb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:34.900158 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ff71447-a18e-479c-93ed-f14bc2cc7cb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:34.900616 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ff71447-a18e-479c-93ed-f14bc2cc7cb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:34.901351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ff71447-a18e-479c-93ed-f14bc2cc7cb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:34.901771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ff71447-a18e-479c-93ed-f14bc2cc7cb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:34.902222 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ff71447-a18e-479c-93ed-f14bc2cc7cb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:34.936374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ff71447-a18e-479c-93ed-f14bc2cc7cb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:34.936845 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ff71447-a18e-479c-93ed-f14bc2cc7cb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:34.937277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ff71447-a18e-479c-93ed-f14bc2cc7cb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:34.937710 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-6ff71447-a18e-479c-93ed-f14bc2cc7cb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lazy-loading 'fault' on Instance uuid 8cd7bdba-2bb2-4f07-91d6-259c3af250e8 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:06:34.977489 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6ff71447-a18e-479c-93ed-f14bc2cc7cb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:34.985493 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6ff71447-a18e-479c-93ed-f14bc2cc7cb4 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 200 len: 1335 microversion: 2.1 time: 0.097364 Sep 13 07:06:34.986312 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 367/706] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:34 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 1335 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:36.015314 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-51518ed1-8877-40a7-a688-dcabc30b83bf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:36.016279 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-51518ed1-8877-40a7-a688-dcabc30b83bf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8cd7bdba-2bb2-4f07-91d6-259c3af250e8] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:36.025625 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-51518ed1-8877-40a7-a688-dcabc30b83bf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:36.026404 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-51518ed1-8877-40a7-a688-dcabc30b83bf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:36.027027 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-51518ed1-8877-40a7-a688-dcabc30b83bf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:36.028127 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-51518ed1-8877-40a7-a688-dcabc30b83bf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:36.028825 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-51518ed1-8877-40a7-a688-dcabc30b83bf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:36.029474 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-51518ed1-8877-40a7-a688-dcabc30b83bf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:36.045923 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-51518ed1-8877-40a7-a688-dcabc30b83bf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] HTTP exception thrown: Instance 8cd7bdba-2bb2-4f07-91d6-259c3af250e8 could not be found. Sep 13 07:06:36.047604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-51518ed1-8877-40a7-a688-dcabc30b83bf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Request method failure captured: Sep 13 07:06:36.047604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 HTTP/1.1 Sep 13 07:06:36.047604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:06:36.047604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:06:36.047604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:06:36.047604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:06:36.047604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:06:36.047604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:06:36.047604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:06:36.047604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:06:36.047604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICqyQRLq_Qa1Tuxe68eosGmwt0cfbE0QkaoApj_vZMNT1tVfE9Z1aCGGEvvN2J5jEsNGtKZpwqKXbs-2kDkDTvieMwn3svXsvAJgMxZJF1u4g7iovW_UVB6Z-NWEeEosMH3ZRZftb8qQnq25CtsFAl2rJIxNetNMQK-S7hv1WD2Jc6s Sep 13 07:06:36.047604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:06:36.047604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:06:36.047604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:06:36.047604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:06:36.047604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:06:36.047604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:06:36.047604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: 38b6d7b146a34896bb8309e2c51348f8 Sep 13 07:06:36.047604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-806686784 Sep 13 07:06:36.047604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:06:36.047604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:06:36.049229 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b6d7b146a34896bb8309e2c51348f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b6d7b146a34896bb8309e2c51348f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b6d7b146a34896bb8309e2c51348f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b6d7b146a34896bb8309e2c51348f8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:06:36.049229 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-ServerRescueNegativeTestJSON-806686784 Sep 13 07:06:36.049229 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 38b6d7b146a34896bb8309e2c51348f8 Sep 13 07:06:36.049229 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-806686784 Sep 13 07:06:36.049229 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-ServerRescueNegativeTestJSON-806686784-project Sep 13 07:06:36.049229 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:06:36.049229 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:06:36.049229 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: 0d8d0ff010c04d65b36ebe65c1cbbbfd Sep 13 07:06:36.049229 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-ServerRescueNegativeTestJSON-806686784-project Sep 13 07:06:36.049229 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:06:36.049229 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Instance 8cd7bdba-2bb2-4f07-91d6-259c3af250e8 could not be found. Sep 13 07:06:36.049229 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': '8cd7bdba-2bb2-4f07-91d6-259c3af250e8'} Sep 13 07:06:36.050303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:06:36.050303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:06:36.050303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:06:36.050303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:06:36.050303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:06:36.050303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:06:36.050303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:06:36.050303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:06:36.050303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:06:36.050303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:06:36.050303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd7bdba-2bb2-4f07-91d6-259c3af250e8 could not be found. Sep 13 07:06:36.050303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:06:36.050303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:06:36.050303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:06:36.050303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:06:36.050303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:06:36.050303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:06:36.050303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:06:36.050303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:06:36.050303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:06:36.051979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:06:36.051979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:06:36.051979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:06:36.051979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:06:36.051979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:06:36.051979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:06:36.051979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:06:36.051979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd7bdba-2bb2-4f07-91d6-259c3af250e8 could not be found. Sep 13 07:06:36.051979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:06:36.051979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:06:36.051979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:06:36.051979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:06:36.051979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:06:36.051979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:06:36.051979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:06:36.051979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:06:36.051979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd7bdba-2bb2-4f07-91d6-259c3af250e8 could not be found. Sep 13 07:06:36.051979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:06:36.053275 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-51518ed1-8877-40a7-a688-dcabc30b83bf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Returning 404 to user: Instance 8cd7bdba-2bb2-4f07-91d6-259c3af250e8 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:06:36.053275 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-51518ed1-8877-40a7-a688-dcabc30b83bf tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8" status: 404 len: 111 microversion: 2.1 time: 0.042319 Sep 13 07:06:36.053275 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 340/707] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:36 2022] GET /compute/v2.1/servers/8cd7bdba-2bb2-4f07-91d6-259c3af250e8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:06:36.060818 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b4b2c64e-8956-49f0-bc57-ead4176d4721 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '.version_select at 0x7f4c1959aee0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:36.069740 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:36.085556 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b4b2c64e-8956-49f0-bc57-ead4176d4721 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721147787" status: 202 len: 0 microversion: 2.1 time: 0.031399 Sep 13 07:06:36.086141 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 368/708] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Sep 13 07:06:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721147787 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:06:39.000912 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ae8a8607-eb12-4d3b-bc0d-ae81ab455236 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:39.001468 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ae8a8607-eb12-4d3b-bc0d-ae81ab455236 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:39.008552 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ae8a8607-eb12-4d3b-bc0d-ae81ab455236 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:39.009032 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ae8a8607-eb12-4d3b-bc0d-ae81ab455236 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:39.009461 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ae8a8607-eb12-4d3b-bc0d-ae81ab455236 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:39.010139 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ae8a8607-eb12-4d3b-bc0d-ae81ab455236 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:39.010724 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ae8a8607-eb12-4d3b-bc0d-ae81ab455236 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:39.011144 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ae8a8607-eb12-4d3b-bc0d-ae81ab455236 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:39.038500 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ae8a8607-eb12-4d3b-bc0d-ae81ab455236 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:06:39.128173 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ae8a8607-eb12-4d3b-bc0d-ae81ab455236 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "DELETE /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 204 len: 0 microversion: 2.1 time: 0.130427 Sep 13 07:06:39.129296 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 341/709] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:06:38 2022] DELETE /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:06:39.138505 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c736743e-a745-4c4f-ae78-d7c6a7695012 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:39.139151 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c736743e-a745-4c4f-ae78-d7c6a7695012 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:39.145254 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c736743e-a745-4c4f-ae78-d7c6a7695012 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:39.146040 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c736743e-a745-4c4f-ae78-d7c6a7695012 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:39.146491 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c736743e-a745-4c4f-ae78-d7c6a7695012 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:39.147185 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c736743e-a745-4c4f-ae78-d7c6a7695012 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:39.147633 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c736743e-a745-4c4f-ae78-d7c6a7695012 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:39.148049 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c736743e-a745-4c4f-ae78-d7c6a7695012 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:39.285978 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c736743e-a745-4c4f-ae78-d7c6a7695012 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:39.294024 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c736743e-a745-4c4f-ae78-d7c6a7695012 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1504 microversion: 2.1 time: 0.160329 Sep 13 07:06:39.294636 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 369/710] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:39 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:40.323853 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-08daa997-e7f9-42db-9240-473c5df3a11e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:40.324890 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-08daa997-e7f9-42db-9240-473c5df3a11e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:40.334987 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-08daa997-e7f9-42db-9240-473c5df3a11e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:40.335474 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-08daa997-e7f9-42db-9240-473c5df3a11e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:40.335907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-08daa997-e7f9-42db-9240-473c5df3a11e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:40.336701 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-08daa997-e7f9-42db-9240-473c5df3a11e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:40.337206 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-08daa997-e7f9-42db-9240-473c5df3a11e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:40.337669 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-08daa997-e7f9-42db-9240-473c5df3a11e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:40.467447 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-08daa997-e7f9-42db-9240-473c5df3a11e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:40.475570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-08daa997-e7f9-42db-9240-473c5df3a11e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1504 microversion: 2.1 time: 0.159357 Sep 13 07:06:40.476188 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 342/711] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:40 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:41.501276 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9bb97c6d-dc71-4d8e-bd1d-94a638a9a561 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:41.501903 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9bb97c6d-dc71-4d8e-bd1d-94a638a9a561 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:41.510308 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9bb97c6d-dc71-4d8e-bd1d-94a638a9a561 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:41.510792 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9bb97c6d-dc71-4d8e-bd1d-94a638a9a561 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:41.511223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9bb97c6d-dc71-4d8e-bd1d-94a638a9a561 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:41.511911 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9bb97c6d-dc71-4d8e-bd1d-94a638a9a561 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:41.512367 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9bb97c6d-dc71-4d8e-bd1d-94a638a9a561 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:41.512802 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9bb97c6d-dc71-4d8e-bd1d-94a638a9a561 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:41.653481 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9bb97c6d-dc71-4d8e-bd1d-94a638a9a561 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:41.663031 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9bb97c6d-dc71-4d8e-bd1d-94a638a9a561 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1504 microversion: 2.1 time: 0.168196 Sep 13 07:06:41.663770 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 370/712] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:41 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:42.090045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-a401166e-4e7c-4667-885e-b619248e554c req-f0bf7301-6049-4bca-b4ff-66d57e1ce7ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b2d57b-6193-4a49-9ff3-334ada85b470", "name": "network-vif-deleted", "tag": "8298a4a7-541f-414c-9b75-7bc68d05e531"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:06:42.102309 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-a401166e-4e7c-4667-885e-b619248e554c req-f0bf7301-6049-4bca-b4ff-66d57e1ce7ac service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:42.102789 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-a401166e-4e7c-4667-885e-b619248e554c req-f0bf7301-6049-4bca-b4ff-66d57e1ce7ac service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:42.103209 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-a401166e-4e7c-4667-885e-b619248e554c req-f0bf7301-6049-4bca-b4ff-66d57e1ce7ac service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:42.117210 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-a401166e-4e7c-4667-885e-b619248e554c req-f0bf7301-6049-4bca-b4ff-66d57e1ce7ac service nova] Creating event network-vif-deleted:8298a4a7-541f-414c-9b75-7bc68d05e531 for instance 49b2d57b-6193-4a49-9ff3-334ada85b470 on hv-cinder-85694 Sep 13 07:06:42.122366 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-a401166e-4e7c-4667-885e-b619248e554c req-f0bf7301-6049-4bca-b4ff-66d57e1ce7ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036159 Sep 13 07:06:42.122956 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 343/713] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:06:42.689570 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-68d8c2ec-3f3a-4db5-b006-1e69302e18d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:42.690522 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-68d8c2ec-3f3a-4db5-b006-1e69302e18d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:42.700592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68d8c2ec-3f3a-4db5-b006-1e69302e18d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:42.701329 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68d8c2ec-3f3a-4db5-b006-1e69302e18d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:42.701982 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68d8c2ec-3f3a-4db5-b006-1e69302e18d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:42.703220 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68d8c2ec-3f3a-4db5-b006-1e69302e18d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:42.703920 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68d8c2ec-3f3a-4db5-b006-1e69302e18d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:42.704561 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68d8c2ec-3f3a-4db5-b006-1e69302e18d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:42.737397 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68d8c2ec-3f3a-4db5-b006-1e69302e18d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:42.737868 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68d8c2ec-3f3a-4db5-b006-1e69302e18d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:42.738331 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68d8c2ec-3f3a-4db5-b006-1e69302e18d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:42.738749 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-68d8c2ec-3f3a-4db5-b006-1e69302e18d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lazy-loading 'fault' on Instance uuid 49b2d57b-6193-4a49-9ff3-334ada85b470 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:06:42.780738 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-68d8c2ec-3f3a-4db5-b006-1e69302e18d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:42.788702 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-68d8c2ec-3f3a-4db5-b006-1e69302e18d7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 200 len: 1312 microversion: 2.1 time: 0.105051 Sep 13 07:06:42.789347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 371/714] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:42 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:43.402693 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-cc8088fb-dd8f-40b0-b8da-30ac6b7fa609 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:43.403240 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-cc8088fb-dd8f-40b0-b8da-30ac6b7fa609 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:43.413505 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cc8088fb-dd8f-40b0-b8da-30ac6b7fa609 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:43.414255 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cc8088fb-dd8f-40b0-b8da-30ac6b7fa609 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:43.414752 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cc8088fb-dd8f-40b0-b8da-30ac6b7fa609 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:43.415774 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cc8088fb-dd8f-40b0-b8da-30ac6b7fa609 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:43.416418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cc8088fb-dd8f-40b0-b8da-30ac6b7fa609 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:43.416998 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cc8088fb-dd8f-40b0-b8da-30ac6b7fa609 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:43.444668 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-cc8088fb-dd8f-40b0-b8da-30ac6b7fa609 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da/ips" status: 200 len: 152 microversion: 2.20 time: 0.172877 Sep 13 07:06:43.445218 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 344/715] 10.222.0.25 () {60 vars in 1289 bytes} [Tue Sep 13 07:06:43 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da/ips => generated 152 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:06:43.812296 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-eb0a6938-358e-4508-8d9a-150b4649da6f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:43.812886 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-eb0a6938-358e-4508-8d9a-150b4649da6f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 49b2d57b-6193-4a49-9ff3-334ada85b470] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:43.819757 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb0a6938-358e-4508-8d9a-150b4649da6f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:43.820264 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb0a6938-358e-4508-8d9a-150b4649da6f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:43.820690 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb0a6938-358e-4508-8d9a-150b4649da6f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:43.821393 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb0a6938-358e-4508-8d9a-150b4649da6f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:43.821831 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb0a6938-358e-4508-8d9a-150b4649da6f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:43.822313 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb0a6938-358e-4508-8d9a-150b4649da6f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:43.835860 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-eb0a6938-358e-4508-8d9a-150b4649da6f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] HTTP exception thrown: Instance 49b2d57b-6193-4a49-9ff3-334ada85b470 could not be found. Sep 13 07:06:43.837410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-eb0a6938-358e-4508-8d9a-150b4649da6f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Request method failure captured: Sep 13 07:06:43.837410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 HTTP/1.1 Sep 13 07:06:43.837410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:06:43.837410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:06:43.837410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:06:43.837410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:06:43.837410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:06:43.837410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:06:43.837410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:06:43.837410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:06:43.837410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICqyQRLq_Qa1Tuxe68eosGmwt0cfbE0QkaoApj_vZMNT1tVfE9Z1aCGGEvvN2J5jEsNGtKZpwqKXbs-2kDkDTvieMwn3svXsvAJgMxZJF1u4g7iovW_UVB6Z-NWEeEosMH3ZRZftb8qQnq25CtsFAl2rJIxNetNMQK-S7hv1WD2Jc6s Sep 13 07:06:43.837410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:06:43.837410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:06:43.837410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:06:43.837410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:06:43.837410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:06:43.837410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:06:43.837410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 38b6d7b146a34896bb8309e2c51348f8 Sep 13 07:06:43.837410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-806686784 Sep 13 07:06:43.837410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:06:43.837410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:06:43.838844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b6d7b146a34896bb8309e2c51348f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b6d7b146a34896bb8309e2c51348f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b6d7b146a34896bb8309e2c51348f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b6d7b146a34896bb8309e2c51348f8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:06:43.838844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-ServerRescueNegativeTestJSON-806686784 Sep 13 07:06:43.838844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 38b6d7b146a34896bb8309e2c51348f8 Sep 13 07:06:43.838844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-806686784 Sep 13 07:06:43.838844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-ServerRescueNegativeTestJSON-806686784-project Sep 13 07:06:43.838844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:06:43.838844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:06:43.838844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 0d8d0ff010c04d65b36ebe65c1cbbbfd Sep 13 07:06:43.838844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-ServerRescueNegativeTestJSON-806686784-project Sep 13 07:06:43.838844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:06:43.838844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance 49b2d57b-6193-4a49-9ff3-334ada85b470 could not be found. Sep 13 07:06:43.838844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': '49b2d57b-6193-4a49-9ff3-334ada85b470'} Sep 13 07:06:43.839621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:06:43.839621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:06:43.839621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:06:43.839621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:06:43.839621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:06:43.839621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:06:43.839621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:06:43.839621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:06:43.839621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:06:43.839621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:06:43.839621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49b2d57b-6193-4a49-9ff3-334ada85b470 could not be found. Sep 13 07:06:43.839621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:06:43.839621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:06:43.839621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:06:43.839621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:06:43.839621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:06:43.839621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:06:43.839621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:06:43.839621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:06:43.839621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:06:43.841013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:06:43.841013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:06:43.841013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:06:43.841013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:06:43.841013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:06:43.841013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:06:43.841013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:06:43.841013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49b2d57b-6193-4a49-9ff3-334ada85b470 could not be found. Sep 13 07:06:43.841013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:06:43.841013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:06:43.841013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:06:43.841013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:06:43.841013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:06:43.841013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:06:43.841013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:06:43.841013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:06:43.841013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49b2d57b-6193-4a49-9ff3-334ada85b470 could not be found. Sep 13 07:06:43.841013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:06:43.842380 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-eb0a6938-358e-4508-8d9a-150b4649da6f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Returning 404 to user: Instance 49b2d57b-6193-4a49-9ff3-334ada85b470 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:06:43.842380 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-eb0a6938-358e-4508-8d9a-150b4649da6f tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470" status: 404 len: 111 microversion: 2.1 time: 0.030562 Sep 13 07:06:43.842380 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 372/716] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:43 2022] GET /compute/v2.1/servers/49b2d57b-6193-4a49-9ff3-334ada85b470 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:06:43.847638 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-eccc72aa-2dcd-4239-8fdd-f698ac033ca3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:43.848124 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-eccc72aa-2dcd-4239-8fdd-f698ac033ca3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:43.854563 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eccc72aa-2dcd-4239-8fdd-f698ac033ca3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:43.855042 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eccc72aa-2dcd-4239-8fdd-f698ac033ca3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:43.855466 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eccc72aa-2dcd-4239-8fdd-f698ac033ca3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:43.856145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eccc72aa-2dcd-4239-8fdd-f698ac033ca3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:43.856586 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eccc72aa-2dcd-4239-8fdd-f698ac033ca3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:43.856998 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eccc72aa-2dcd-4239-8fdd-f698ac033ca3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:43.882881 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-eccc72aa-2dcd-4239-8fdd-f698ac033ca3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:06:43.964759 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-eccc72aa-2dcd-4239-8fdd-f698ac033ca3 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 204 len: 0 microversion: 2.1 time: 0.120640 Sep 13 07:06:43.965340 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 345/717] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:06:43 2022] DELETE /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 07:06:43.973450 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-83e52034-b94d-4d98-9d50-4d5c2aa9dd4e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:43.974185 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-83e52034-b94d-4d98-9d50-4d5c2aa9dd4e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:43.980626 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83e52034-b94d-4d98-9d50-4d5c2aa9dd4e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:43.981113 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83e52034-b94d-4d98-9d50-4d5c2aa9dd4e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:43.981536 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83e52034-b94d-4d98-9d50-4d5c2aa9dd4e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:43.982286 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83e52034-b94d-4d98-9d50-4d5c2aa9dd4e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:43.982733 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83e52034-b94d-4d98-9d50-4d5c2aa9dd4e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:43.983148 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83e52034-b94d-4d98-9d50-4d5c2aa9dd4e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:44.128186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-83e52034-b94d-4d98-9d50-4d5c2aa9dd4e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:44.141288 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-83e52034-b94d-4d98-9d50-4d5c2aa9dd4e tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.171044 Sep 13 07:06:44.142596 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 373/718] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:43 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:45.174920 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-48e44856-909c-45fc-aeed-75a9b235dac7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:45.175901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-48e44856-909c-45fc-aeed-75a9b235dac7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:45.186336 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48e44856-909c-45fc-aeed-75a9b235dac7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:45.187058 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48e44856-909c-45fc-aeed-75a9b235dac7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:45.187704 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48e44856-909c-45fc-aeed-75a9b235dac7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:45.188807 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48e44856-909c-45fc-aeed-75a9b235dac7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:45.189535 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48e44856-909c-45fc-aeed-75a9b235dac7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:45.190246 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48e44856-909c-45fc-aeed-75a9b235dac7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:45.386383 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e9e76a4b-b8dc-45b0-bbda-648e4b60bfd0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:06:45.387004 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e9e76a4b-b8dc-45b0-bbda-648e4b60bfd0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:45.394209 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e9e76a4b-b8dc-45b0-bbda-648e4b60bfd0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:45.394696 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e9e76a4b-b8dc-45b0-bbda-648e4b60bfd0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:45.395119 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e9e76a4b-b8dc-45b0-bbda-648e4b60bfd0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:45.396314 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e9e76a4b-b8dc-45b0-bbda-648e4b60bfd0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:45.396783 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e9e76a4b-b8dc-45b0-bbda-648e4b60bfd0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:45.397208 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e9e76a4b-b8dc-45b0-bbda-648e4b60bfd0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:45.422177 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-e9e76a4b-b8dc-45b0-bbda-648e4b60bfd0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lazy-loading 'flavor' on Instance uuid 8c1166e7-c092-4bde-b87c-cb8aaa1918da {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:06:45.588654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-48e44856-909c-45fc-aeed-75a9b235dac7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:45.598250 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-48e44856-909c-45fc-aeed-75a9b235dac7 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.430436 Sep 13 07:06:45.599015 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 346/719] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:45 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:45.642144 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e9e76a4b-b8dc-45b0-bbda-648e4b60bfd0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "POST /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da/action" status: 202 len: 0 microversion: 2.20 time: 0.259669 Sep 13 07:06:45.642703 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 374/720] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Sep 13 07:06:45 2022] POST /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:06:45.654150 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9399de6a-0f7e-4cea-a2e8-3691e807d4a7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:45.654880 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9399de6a-0f7e-4cea-a2e8-3691e807d4a7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:45.662074 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9399de6a-0f7e-4cea-a2e8-3691e807d4a7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:45.662535 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9399de6a-0f7e-4cea-a2e8-3691e807d4a7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:45.663048 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9399de6a-0f7e-4cea-a2e8-3691e807d4a7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:45.664140 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9399de6a-0f7e-4cea-a2e8-3691e807d4a7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:45.664786 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9399de6a-0f7e-4cea-a2e8-3691e807d4a7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:45.665402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9399de6a-0f7e-4cea-a2e8-3691e807d4a7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:45.799981 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9399de6a-0f7e-4cea-a2e8-3691e807d4a7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:45.813306 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9399de6a-0f7e-4cea-a2e8-3691e807d4a7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:45.815588 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9399de6a-0f7e-4cea-a2e8-3691e807d4a7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:45.817527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9399de6a-0f7e-4cea-a2e8-3691e807d4a7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1724 microversion: 2.20 time: 0.168130 Sep 13 07:06:45.818209 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 347/721] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:06:45 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:06:46.623487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6252c6b8-08d7-423f-85da-25f3ab9166eb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:46.624323 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6252c6b8-08d7-423f-85da-25f3ab9166eb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:46.634755 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6252c6b8-08d7-423f-85da-25f3ab9166eb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:46.635235 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6252c6b8-08d7-423f-85da-25f3ab9166eb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:46.635666 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6252c6b8-08d7-423f-85da-25f3ab9166eb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:46.636353 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6252c6b8-08d7-423f-85da-25f3ab9166eb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:46.636797 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6252c6b8-08d7-423f-85da-25f3ab9166eb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:46.637214 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6252c6b8-08d7-423f-85da-25f3ab9166eb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:46.775099 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6252c6b8-08d7-423f-85da-25f3ab9166eb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:46.783282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6252c6b8-08d7-423f-85da-25f3ab9166eb tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1519 microversion: 2.1 time: 0.165153 Sep 13 07:06:46.783861 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 375/722] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:46 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:46.845278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6c359875-5263-4f5e-a8a6-2a56bc4bf4ab tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:46.846159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6c359875-5263-4f5e-a8a6-2a56bc4bf4ab tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:46.854862 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6c359875-5263-4f5e-a8a6-2a56bc4bf4ab tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:46.855669 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6c359875-5263-4f5e-a8a6-2a56bc4bf4ab tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:46.856355 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6c359875-5263-4f5e-a8a6-2a56bc4bf4ab tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:46.857437 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6c359875-5263-4f5e-a8a6-2a56bc4bf4ab tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:46.858152 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6c359875-5263-4f5e-a8a6-2a56bc4bf4ab tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:46.858869 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6c359875-5263-4f5e-a8a6-2a56bc4bf4ab tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:46.992817 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6c359875-5263-4f5e-a8a6-2a56bc4bf4ab tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:47.001419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6c359875-5263-4f5e-a8a6-2a56bc4bf4ab tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:47.002889 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6c359875-5263-4f5e-a8a6-2a56bc4bf4ab tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:47.004089 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6c359875-5263-4f5e-a8a6-2a56bc4bf4ab tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1724 microversion: 2.20 time: 0.164845 Sep 13 07:06:47.004649 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 348/723] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:06:46 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:06:47.230495 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-82e6061d-2494-4674-990c-810fc3a1b079 req-59a7cbca-87e2-49cf-8578-be880c0a25c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8082cb10-169b-478f-9b71-7680fe245559", "name": "network-vif-deleted", "tag": "827c4775-bb8b-4e51-8c12-4fe64b1bf6ec"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:06:47.239907 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-82e6061d-2494-4674-990c-810fc3a1b079 req-59a7cbca-87e2-49cf-8578-be880c0a25c8 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:47.240388 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-82e6061d-2494-4674-990c-810fc3a1b079 req-59a7cbca-87e2-49cf-8578-be880c0a25c8 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:47.240807 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-82e6061d-2494-4674-990c-810fc3a1b079 req-59a7cbca-87e2-49cf-8578-be880c0a25c8 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:47.252141 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-82e6061d-2494-4674-990c-810fc3a1b079 req-59a7cbca-87e2-49cf-8578-be880c0a25c8 service nova] Creating event network-vif-deleted:827c4775-bb8b-4e51-8c12-4fe64b1bf6ec for instance 8082cb10-169b-478f-9b71-7680fe245559 on hv-cinder-85694 Sep 13 07:06:47.257066 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-82e6061d-2494-4674-990c-810fc3a1b079 req-59a7cbca-87e2-49cf-8578-be880c0a25c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030162 Sep 13 07:06:47.257653 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 376/724] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:06:47.810858 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d1b21d19-63ba-46b3-9018-094b1a89fe83 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:47.811750 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d1b21d19-63ba-46b3-9018-094b1a89fe83 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:47.823193 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d1b21d19-63ba-46b3-9018-094b1a89fe83 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:47.824068 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d1b21d19-63ba-46b3-9018-094b1a89fe83 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:47.824797 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d1b21d19-63ba-46b3-9018-094b1a89fe83 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:47.825925 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d1b21d19-63ba-46b3-9018-094b1a89fe83 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:47.826714 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d1b21d19-63ba-46b3-9018-094b1a89fe83 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:47.827408 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d1b21d19-63ba-46b3-9018-094b1a89fe83 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:47.834565 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:47.863326 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d1b21d19-63ba-46b3-9018-094b1a89fe83 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:47.863986 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d1b21d19-63ba-46b3-9018-094b1a89fe83 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:47.864218 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d1b21d19-63ba-46b3-9018-094b1a89fe83 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:47.864715 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-d1b21d19-63ba-46b3-9018-094b1a89fe83 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lazy-loading 'fault' on Instance uuid 8082cb10-169b-478f-9b71-7680fe245559 {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:06:47.908720 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d1b21d19-63ba-46b3-9018-094b1a89fe83 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d0ff010c04d65b36ebe65c1cbbbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b6d7b146a34896bb8309e2c51348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:47.916819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d1b21d19-63ba-46b3-9018-094b1a89fe83 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 200 len: 1312 microversion: 2.1 time: 0.113118 Sep 13 07:06:47.917366 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 349/725] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:47 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 1312 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:06:48.031707 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-eac82568-66d3-4d50-8e1b-3875cc900df6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:48.032414 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-eac82568-66d3-4d50-8e1b-3875cc900df6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:48.039096 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eac82568-66d3-4d50-8e1b-3875cc900df6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:48.039579 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eac82568-66d3-4d50-8e1b-3875cc900df6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:48.040009 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eac82568-66d3-4d50-8e1b-3875cc900df6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:48.040712 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eac82568-66d3-4d50-8e1b-3875cc900df6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:48.041196 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eac82568-66d3-4d50-8e1b-3875cc900df6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:48.041622 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eac82568-66d3-4d50-8e1b-3875cc900df6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:48.179353 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-eac82568-66d3-4d50-8e1b-3875cc900df6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:48.192925 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-eac82568-66d3-4d50-8e1b-3875cc900df6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:48.194421 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-eac82568-66d3-4d50-8e1b-3875cc900df6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:48.195630 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-eac82568-66d3-4d50-8e1b-3875cc900df6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1724 microversion: 2.20 time: 0.169684 Sep 13 07:06:48.196149 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 377/726] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:06:48 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:06:48.944445 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f8c529b3-a350-454b-8cf4-b1c44887f038 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:48.945173 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f8c529b3-a350-454b-8cf4-b1c44887f038 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] [instance: 8082cb10-169b-478f-9b71-7680fe245559] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:48.953168 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f8c529b3-a350-454b-8cf4-b1c44887f038 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:48.953729 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f8c529b3-a350-454b-8cf4-b1c44887f038 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:48.954264 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f8c529b3-a350-454b-8cf4-b1c44887f038 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:48.955103 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f8c529b3-a350-454b-8cf4-b1c44887f038 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:48.955633 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f8c529b3-a350-454b-8cf4-b1c44887f038 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:48.956117 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f8c529b3-a350-454b-8cf4-b1c44887f038 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:48.972060 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-f8c529b3-a350-454b-8cf4-b1c44887f038 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] HTTP exception thrown: Instance 8082cb10-169b-478f-9b71-7680fe245559 could not be found. Sep 13 07:06:48.973950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f8c529b3-a350-454b-8cf4-b1c44887f038 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Request method failure captured: Sep 13 07:06:48.973950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 HTTP/1.1 Sep 13 07:06:48.973950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:06:48.973950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:06:48.973950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:06:48.973950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:06:48.973950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:06:48.973950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:06:48.973950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:06:48.973950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:06:48.973950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICqyQRLq_Qa1Tuxe68eosGmwt0cfbE0QkaoApj_vZMNT1tVfE9Z1aCGGEvvN2J5jEsNGtKZpwqKXbs-2kDkDTvieMwn3svXsvAJgMxZJF1u4g7iovW_UVB6Z-NWEeEosMH3ZRZftb8qQnq25CtsFAl2rJIxNetNMQK-S7hv1WD2Jc6s Sep 13 07:06:48.973950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:06:48.973950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:06:48.973950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:06:48.973950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:06:48.973950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:06:48.973950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:06:48.973950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: 38b6d7b146a34896bb8309e2c51348f8 Sep 13 07:06:48.973950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-806686784 Sep 13 07:06:48.973950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:06:48.973950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:06:48.975509 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b6d7b146a34896bb8309e2c51348f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b6d7b146a34896bb8309e2c51348f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b6d7b146a34896bb8309e2c51348f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b6d7b146a34896bb8309e2c51348f8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:06:48.975509 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-ServerRescueNegativeTestJSON-806686784 Sep 13 07:06:48.975509 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 38b6d7b146a34896bb8309e2c51348f8 Sep 13 07:06:48.975509 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-806686784 Sep 13 07:06:48.975509 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-ServerRescueNegativeTestJSON-806686784-project Sep 13 07:06:48.975509 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:06:48.975509 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:06:48.975509 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: 0d8d0ff010c04d65b36ebe65c1cbbbfd Sep 13 07:06:48.975509 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-ServerRescueNegativeTestJSON-806686784-project Sep 13 07:06:48.975509 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:06:48.975509 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Instance 8082cb10-169b-478f-9b71-7680fe245559 could not be found. Sep 13 07:06:48.975509 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': '8082cb10-169b-478f-9b71-7680fe245559'} Sep 13 07:06:48.976418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:06:48.976418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:06:48.976418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:06:48.976418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:06:48.976418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:06:48.976418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:06:48.976418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:06:48.976418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:06:48.976418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:06:48.976418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:06:48.976418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8082cb10-169b-478f-9b71-7680fe245559 could not be found. Sep 13 07:06:48.976418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:06:48.976418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:06:48.976418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:06:48.976418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:06:48.976418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:06:48.976418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:06:48.976418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:06:48.976418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:06:48.976418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:06:48.978365 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:06:48.978365 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:06:48.978365 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:06:48.978365 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:06:48.978365 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:06:48.978365 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:06:48.978365 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:06:48.978365 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8082cb10-169b-478f-9b71-7680fe245559 could not be found. Sep 13 07:06:48.978365 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:06:48.978365 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:06:48.978365 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:06:48.978365 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:06:48.978365 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:06:48.978365 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:06:48.978365 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:06:48.978365 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:06:48.978365 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8082cb10-169b-478f-9b71-7680fe245559 could not be found. Sep 13 07:06:48.978365 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:06:48.980291 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f8c529b3-a350-454b-8cf4-b1c44887f038 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] Returning 404 to user: Instance 8082cb10-169b-478f-9b71-7680fe245559 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:06:48.980291 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f8c529b3-a350-454b-8cf4-b1c44887f038 tempest-ServerRescueNegativeTestJSON-806686784 tempest-ServerRescueNegativeTestJSON-806686784-project] 10.222.0.25 "GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559" status: 404 len: 111 microversion: 2.1 time: 0.037606 Sep 13 07:06:48.980291 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 350/727] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:06:48 2022] GET /compute/v2.1/servers/8082cb10-169b-478f-9b71-7680fe245559 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:06:49.221214 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7edc5b17-2c43-4617-bf9f-3b6897535b8d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:49.221777 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7edc5b17-2c43-4617-bf9f-3b6897535b8d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:49.228810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7edc5b17-2c43-4617-bf9f-3b6897535b8d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:49.229270 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7edc5b17-2c43-4617-bf9f-3b6897535b8d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:49.229723 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7edc5b17-2c43-4617-bf9f-3b6897535b8d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:49.230489 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7edc5b17-2c43-4617-bf9f-3b6897535b8d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:49.230974 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7edc5b17-2c43-4617-bf9f-3b6897535b8d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:49.231392 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7edc5b17-2c43-4617-bf9f-3b6897535b8d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:49.250829 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:49.452005 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7edc5b17-2c43-4617-bf9f-3b6897535b8d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:49.462954 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7edc5b17-2c43-4617-bf9f-3b6897535b8d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:49.464386 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7edc5b17-2c43-4617-bf9f-3b6897535b8d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:49.465551 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7edc5b17-2c43-4617-bf9f-3b6897535b8d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1724 microversion: 2.20 time: 0.248472 Sep 13 07:06:49.466330 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 378/728] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:06:49 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:06:50.492064 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6f9adc93-a7fc-45c7-9499-185db2125d79 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:50.492647 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6f9adc93-a7fc-45c7-9499-185db2125d79 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:50.499618 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f9adc93-a7fc-45c7-9499-185db2125d79 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:50.500104 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f9adc93-a7fc-45c7-9499-185db2125d79 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:50.500528 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f9adc93-a7fc-45c7-9499-185db2125d79 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:50.501238 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f9adc93-a7fc-45c7-9499-185db2125d79 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:50.501688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f9adc93-a7fc-45c7-9499-185db2125d79 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:50.502108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f9adc93-a7fc-45c7-9499-185db2125d79 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:50.674492 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6f9adc93-a7fc-45c7-9499-185db2125d79 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:50.683820 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6f9adc93-a7fc-45c7-9499-185db2125d79 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:50.685284 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6f9adc93-a7fc-45c7-9499-185db2125d79 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:50.686490 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6f9adc93-a7fc-45c7-9499-185db2125d79 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1724 microversion: 2.20 time: 0.198675 Sep 13 07:06:50.687048 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 351/729] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:06:50 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:06:51.712546 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a510fa8b-a2a2-4c08-b9bd-991bdc3086d6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:51.713337 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a510fa8b-a2a2-4c08-b9bd-991bdc3086d6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:51.719924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a510fa8b-a2a2-4c08-b9bd-991bdc3086d6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:51.720432 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a510fa8b-a2a2-4c08-b9bd-991bdc3086d6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:51.720875 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a510fa8b-a2a2-4c08-b9bd-991bdc3086d6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:51.721560 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a510fa8b-a2a2-4c08-b9bd-991bdc3086d6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:51.721998 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a510fa8b-a2a2-4c08-b9bd-991bdc3086d6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:51.722435 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a510fa8b-a2a2-4c08-b9bd-991bdc3086d6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:51.857129 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a510fa8b-a2a2-4c08-b9bd-991bdc3086d6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:51.866917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a510fa8b-a2a2-4c08-b9bd-991bdc3086d6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:51.869111 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a510fa8b-a2a2-4c08-b9bd-991bdc3086d6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:51.870046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a510fa8b-a2a2-4c08-b9bd-991bdc3086d6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1724 microversion: 2.20 time: 0.161958 Sep 13 07:06:51.871187 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 379/730] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:06:51 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:06:52.897268 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7af728b3-e650-4bb2-8597-3a330afb1f2a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:52.897885 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7af728b3-e650-4bb2-8597-3a330afb1f2a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:52.904379 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7af728b3-e650-4bb2-8597-3a330afb1f2a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:52.904859 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7af728b3-e650-4bb2-8597-3a330afb1f2a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:52.905286 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7af728b3-e650-4bb2-8597-3a330afb1f2a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:52.906182 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7af728b3-e650-4bb2-8597-3a330afb1f2a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:52.906638 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7af728b3-e650-4bb2-8597-3a330afb1f2a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:52.907059 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7af728b3-e650-4bb2-8597-3a330afb1f2a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:53.041405 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7af728b3-e650-4bb2-8597-3a330afb1f2a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:53.049871 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7af728b3-e650-4bb2-8597-3a330afb1f2a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:53.051348 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7af728b3-e650-4bb2-8597-3a330afb1f2a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:53.052826 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7af728b3-e650-4bb2-8597-3a330afb1f2a tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1724 microversion: 2.20 time: 0.159812 Sep 13 07:06:53.053386 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 352/731] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:06:52 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:06:54.078787 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a94ae7c1-162b-4dd7-b539-7cdb2001958f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:54.079346 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a94ae7c1-162b-4dd7-b539-7cdb2001958f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:54.086466 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a94ae7c1-162b-4dd7-b539-7cdb2001958f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:54.087116 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a94ae7c1-162b-4dd7-b539-7cdb2001958f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:54.087562 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a94ae7c1-162b-4dd7-b539-7cdb2001958f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:54.088282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a94ae7c1-162b-4dd7-b539-7cdb2001958f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:54.088883 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a94ae7c1-162b-4dd7-b539-7cdb2001958f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:54.089242 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a94ae7c1-162b-4dd7-b539-7cdb2001958f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:54.273655 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a94ae7c1-162b-4dd7-b539-7cdb2001958f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:54.284492 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a94ae7c1-162b-4dd7-b539-7cdb2001958f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:54.286180 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a94ae7c1-162b-4dd7-b539-7cdb2001958f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:54.287601 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a94ae7c1-162b-4dd7-b539-7cdb2001958f tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1724 microversion: 2.20 time: 0.212887 Sep 13 07:06:54.288150 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 380/732] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:06:54 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:06:55.315533 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-33e380b5-c6e0-44b7-8df7-194834d467f5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:55.316763 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-33e380b5-c6e0-44b7-8df7-194834d467f5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:55.323749 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-33e380b5-c6e0-44b7-8df7-194834d467f5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:55.324164 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-33e380b5-c6e0-44b7-8df7-194834d467f5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:55.324622 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-33e380b5-c6e0-44b7-8df7-194834d467f5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:55.325310 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-33e380b5-c6e0-44b7-8df7-194834d467f5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:55.325774 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-33e380b5-c6e0-44b7-8df7-194834d467f5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:55.326220 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-33e380b5-c6e0-44b7-8df7-194834d467f5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:55.466699 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-33e380b5-c6e0-44b7-8df7-194834d467f5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:55.475996 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-33e380b5-c6e0-44b7-8df7-194834d467f5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:55.477883 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-33e380b5-c6e0-44b7-8df7-194834d467f5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:55.480422 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-33e380b5-c6e0-44b7-8df7-194834d467f5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1724 microversion: 2.20 time: 0.168814 Sep 13 07:06:55.494106 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 353/733] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:06:55 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:06:56.507032 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-441665a1-0d4f-4d59-a098-59b23496cf32 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:56.507931 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-441665a1-0d4f-4d59-a098-59b23496cf32 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:56.515462 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-441665a1-0d4f-4d59-a098-59b23496cf32 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:56.515949 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-441665a1-0d4f-4d59-a098-59b23496cf32 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:56.516449 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-441665a1-0d4f-4d59-a098-59b23496cf32 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:56.517078 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-441665a1-0d4f-4d59-a098-59b23496cf32 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:56.517705 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-441665a1-0d4f-4d59-a098-59b23496cf32 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:56.518574 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-441665a1-0d4f-4d59-a098-59b23496cf32 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:56.683270 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-441665a1-0d4f-4d59-a098-59b23496cf32 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:56.698949 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-441665a1-0d4f-4d59-a098-59b23496cf32 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:56.700704 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-441665a1-0d4f-4d59-a098-59b23496cf32 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:56.702096 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-441665a1-0d4f-4d59-a098-59b23496cf32 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1724 microversion: 2.20 time: 0.199090 Sep 13 07:06:56.703167 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 381/734] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:06:56 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:06:57.738297 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-599bcb3d-1e7b-48d7-907b-c9049f912215 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:57.739843 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-599bcb3d-1e7b-48d7-907b-c9049f912215 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:57.749483 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-599bcb3d-1e7b-48d7-907b-c9049f912215 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:57.750216 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-599bcb3d-1e7b-48d7-907b-c9049f912215 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:57.751082 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-599bcb3d-1e7b-48d7-907b-c9049f912215 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:57.752343 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-599bcb3d-1e7b-48d7-907b-c9049f912215 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:57.753339 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-599bcb3d-1e7b-48d7-907b-c9049f912215 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:57.754691 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-599bcb3d-1e7b-48d7-907b-c9049f912215 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:57.967691 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-599bcb3d-1e7b-48d7-907b-c9049f912215 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:57.969200 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f1dd7d3c-f068-46a3-aac8-44f2f7708f70 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Action: 'create', calling method: .version_select at 0x7f4c194dedc0>, body: {"keypair": {"name": "tempest-keypair-1744464638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBThfxQx15gzg00CnYisrsmz9ImXd0/2RUkTF/C8cktIda2Qf+Hgg2Ms94nwF3JplJzRyjqQVzvsLCCrm/EftoCmaQFwo+ODTC9Bkt600jcilHv5FjM19qXBkjpD5iPcJA=="}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:06:57.977401 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-599bcb3d-1e7b-48d7-907b-c9049f912215 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:57.980096 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-599bcb3d-1e7b-48d7-907b-c9049f912215 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:57.981500 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-599bcb3d-1e7b-48d7-907b-c9049f912215 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1745 microversion: 2.20 time: 0.255689 Sep 13 07:06:57.982064 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 354/735] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:06:57 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1745 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:06:57.991182 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-f1dd7d3c-f068-46a3-aac8-44f2f7708f70 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Getting quotas for project 0f2d19ffb32443babaa154c5766b6982. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:06:57.995787 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-f1dd7d3c-f068-46a3-aac8-44f2f7708f70 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Getting quotas for user a8576530b4ed4749a1e138f975d9b8b9 and project 0f2d19ffb32443babaa154c5766b6982. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:06:58.025771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f1dd7d3c-f068-46a3-aac8-44f2f7708f70 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.240517 Sep 13 07:06:58.026427 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 382/736] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Sep 13 07:06:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:06:59.008335 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-77f8f02e-3f22-4ce0-99af-ab9b292dbb03 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:06:59.009047 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-77f8f02e-3f22-4ce0-99af-ab9b292dbb03 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:06:59.016839 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-77f8f02e-3f22-4ce0-99af-ab9b292dbb03 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:59.017048 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-77f8f02e-3f22-4ce0-99af-ab9b292dbb03 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:59.017462 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-77f8f02e-3f22-4ce0-99af-ab9b292dbb03 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:59.018570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-77f8f02e-3f22-4ce0-99af-ab9b292dbb03 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:59.018690 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-77f8f02e-3f22-4ce0-99af-ab9b292dbb03 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:59.019020 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-77f8f02e-3f22-4ce0-99af-ab9b292dbb03 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:59.167982 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-77f8f02e-3f22-4ce0-99af-ab9b292dbb03 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:59.177348 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-77f8f02e-3f22-4ce0-99af-ab9b292dbb03 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:59.179192 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-77f8f02e-3f22-4ce0-99af-ab9b292dbb03 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:06:59.181469 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-77f8f02e-3f22-4ce0-99af-ab9b292dbb03 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1745 microversion: 2.20 time: 0.177155 Sep 13 07:06:59.182149 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 355/737] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:06:59 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:06:59.444355 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-25283f40-1f35-4121-9369-019b153ead06 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1193835854", "imageRef": "19a6700e-e153-4bea-87aa-036bfccf0ecd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de769f76-c16e-4308-8d87-174634377b5a"}], "security_groups": [{"name": "tempest-securitygroup--1428577638"}], "key_name": "tempest-keypair-1744464638", "user_data": "}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:06:59.562068 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-25283f40-1f35-4121-9369-019b153ead06 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] validate_networks() for [('de769f76-c16e-4308-8d87-174634377b5a', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:06:59.867156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-076d3f88-6b49-4fcc-a5b6-36009a486151 req-e97babe6-7d28-4831-891e-016d73f340e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1166e7-c092-4bde-b87c-cb8aaa1918da", "name": "network-vif-plugged", "status": "completed", "tag": "dc830de4-1081-4c18-ada7-433d5588216c"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:06:59.895891 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:59.914217 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-076d3f88-6b49-4fcc-a5b6-36009a486151 req-e97babe6-7d28-4831-891e-016d73f340e4 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:06:59.915026 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-076d3f88-6b49-4fcc-a5b6-36009a486151 req-e97babe6-7d28-4831-891e-016d73f340e4 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:06:59.915732 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-076d3f88-6b49-4fcc-a5b6-36009a486151 req-e97babe6-7d28-4831-891e-016d73f340e4 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:06:59.941276 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-076d3f88-6b49-4fcc-a5b6-36009a486151 req-e97babe6-7d28-4831-891e-016d73f340e4 service nova] Creating event network-vif-plugged:dc830de4-1081-4c18-ada7-433d5588216c for instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da on hv-cinder-85694 Sep 13 07:06:59.948338 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-076d3f88-6b49-4fcc-a5b6-36009a486151 req-e97babe6-7d28-4831-891e-016d73f340e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172273 Sep 13 07:06:59.949254 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 356/738] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:07:00.109346 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-25283f40-1f35-4121-9369-019b153ead06 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:07:00.109822 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-25283f40-1f35-4121-9369-019b153ead06 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:07:00.110324 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-25283f40-1f35-4121-9369-019b153ead06 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:07:00.110733 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-25283f40-1f35-4121-9369-019b153ead06 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:07:00.111132 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-25283f40-1f35-4121-9369-019b153ead06 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:07:00.125446 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25283f40-1f35-4121-9369-019b153ead06 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:00.125919 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25283f40-1f35-4121-9369-019b153ead06 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:00.126375 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25283f40-1f35-4121-9369-019b153ead06 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:00.127108 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25283f40-1f35-4121-9369-019b153ead06 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:00.127549 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25283f40-1f35-4121-9369-019b153ead06 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:00.127960 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25283f40-1f35-4121-9369-019b153ead06 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:00.148740 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-25283f40-1f35-4121-9369-019b153ead06 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Getting quotas for project 0f2d19ffb32443babaa154c5766b6982. Resources: {'instances', 'cores', 'ram'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:07:00.155145 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-25283f40-1f35-4121-9369-019b153ead06 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Getting quotas for user a8576530b4ed4749a1e138f975d9b8b9 and project 0f2d19ffb32443babaa154c5766b6982. Resources: {'instances', 'cores', 'ram'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:07:00.167011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-25283f40-1f35-4121-9369-019b153ead06 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:07:00.169252 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-25283f40-1f35-4121-9369-019b153ead06 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='19a6700e-e153-4bea-87aa-036bfccf0ecd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:07:00.215415 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2d3ea35f-472d-4d6e-a084-43b8a0f9c941 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:00.217578 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2d3ea35f-472d-4d6e-a084-43b8a0f9c941 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:00.225618 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-25283f40-1f35-4121-9369-019b153ead06 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.786106 Sep 13 07:07:00.227002 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 383/739] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Sep 13 07:06:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 07:07:00.240327 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2d3ea35f-472d-4d6e-a084-43b8a0f9c941 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:00.243780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2d3ea35f-472d-4d6e-a084-43b8a0f9c941 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:00.244743 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2d3ea35f-472d-4d6e-a084-43b8a0f9c941 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:00.245182 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8ba12803-d53a-4c2c-8eb8-e3bee9b967ce tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:00.246462 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8ba12803-d53a-4c2c-8eb8-e3bee9b967ce tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:00.258990 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2d3ea35f-472d-4d6e-a084-43b8a0f9c941 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:00.259830 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2d3ea35f-472d-4d6e-a084-43b8a0f9c941 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:00.267979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2d3ea35f-472d-4d6e-a084-43b8a0f9c941 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:00.309279 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8ba12803-d53a-4c2c-8eb8-e3bee9b967ce tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:00.318519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8ba12803-d53a-4c2c-8eb8-e3bee9b967ce tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1238 microversion: 2.1 time: 0.083880 Sep 13 07:07:00.319526 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 384/740] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:00 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:00.512989 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2d3ea35f-472d-4d6e-a084-43b8a0f9c941 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:00.543378 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2d3ea35f-472d-4d6e-a084-43b8a0f9c941 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:00.545349 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2d3ea35f-472d-4d6e-a084-43b8a0f9c941 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:00.546863 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2d3ea35f-472d-4d6e-a084-43b8a0f9c941 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1740 microversion: 2.20 time: 0.342366 Sep 13 07:07:00.548120 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 357/741] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:00 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1740 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:01.344139 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ae99a517-5399-4153-8f4d-f6a0a4904c0a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:01.344712 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ae99a517-5399-4153-8f4d-f6a0a4904c0a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:01.363266 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae99a517-5399-4153-8f4d-f6a0a4904c0a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:01.363801 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae99a517-5399-4153-8f4d-f6a0a4904c0a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:01.364244 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae99a517-5399-4153-8f4d-f6a0a4904c0a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:01.367279 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae99a517-5399-4153-8f4d-f6a0a4904c0a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:01.367814 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae99a517-5399-4153-8f4d-f6a0a4904c0a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:01.368355 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae99a517-5399-4153-8f4d-f6a0a4904c0a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:01.454263 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ae99a517-5399-4153-8f4d-f6a0a4904c0a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:01.462519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ae99a517-5399-4153-8f4d-f6a0a4904c0a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1290 microversion: 2.1 time: 0.122756 Sep 13 07:07:01.464695 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 385/742] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:01 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1290 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:01.575441 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a5c0a69f-96ec-44f4-8d07-becdf08341b5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:01.576854 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a5c0a69f-96ec-44f4-8d07-becdf08341b5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:01.587516 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a5c0a69f-96ec-44f4-8d07-becdf08341b5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:01.588096 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a5c0a69f-96ec-44f4-8d07-becdf08341b5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:01.588597 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a5c0a69f-96ec-44f4-8d07-becdf08341b5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:01.589405 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a5c0a69f-96ec-44f4-8d07-becdf08341b5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:01.589934 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a5c0a69f-96ec-44f4-8d07-becdf08341b5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:01.590435 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a5c0a69f-96ec-44f4-8d07-becdf08341b5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:01.770751 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a5c0a69f-96ec-44f4-8d07-becdf08341b5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:01.781171 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a5c0a69f-96ec-44f4-8d07-becdf08341b5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:01.782779 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a5c0a69f-96ec-44f4-8d07-becdf08341b5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:01.784060 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a5c0a69f-96ec-44f4-8d07-becdf08341b5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1740 microversion: 2.20 time: 0.214928 Sep 13 07:07:01.799098 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 358/743] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:01 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:02.486721 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-924ea97f-41fe-443d-b204-3b61b20db368 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:02.487423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-924ea97f-41fe-443d-b204-3b61b20db368 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:02.496092 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-924ea97f-41fe-443d-b204-3b61b20db368 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:02.496949 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-924ea97f-41fe-443d-b204-3b61b20db368 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:02.497853 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-924ea97f-41fe-443d-b204-3b61b20db368 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:02.498848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-924ea97f-41fe-443d-b204-3b61b20db368 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:02.499604 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-924ea97f-41fe-443d-b204-3b61b20db368 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:02.500274 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-924ea97f-41fe-443d-b204-3b61b20db368 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:02.586510 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-924ea97f-41fe-443d-b204-3b61b20db368 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:02.595939 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-924ea97f-41fe-443d-b204-3b61b20db368 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1296 microversion: 2.1 time: 0.113554 Sep 13 07:07:02.606638 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 386/744] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:02 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1296 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:02.821286 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9e1bcd4c-f056-4ae8-b195-a94871ddbed7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:02.823119 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9e1bcd4c-f056-4ae8-b195-a94871ddbed7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:02.840278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd4c-f056-4ae8-b195-a94871ddbed7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:02.841837 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd4c-f056-4ae8-b195-a94871ddbed7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:02.842463 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd4c-f056-4ae8-b195-a94871ddbed7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:02.843497 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd4c-f056-4ae8-b195-a94871ddbed7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:02.844151 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd4c-f056-4ae8-b195-a94871ddbed7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:02.844742 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd4c-f056-4ae8-b195-a94871ddbed7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:03.133372 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9e1bcd4c-f056-4ae8-b195-a94871ddbed7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:03.145554 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9e1bcd4c-f056-4ae8-b195-a94871ddbed7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:03.147245 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9e1bcd4c-f056-4ae8-b195-a94871ddbed7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:03.148724 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9e1bcd4c-f056-4ae8-b195-a94871ddbed7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1740 microversion: 2.20 time: 0.339650 Sep 13 07:07:03.162671 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 359/745] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:02 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1740 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:03.622539 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c4eabde9-cca7-42cf-b77e-ae3ad231ebb6 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:03.622539 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c4eabde9-cca7-42cf-b77e-ae3ad231ebb6 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:03.629642 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c4eabde9-cca7-42cf-b77e-ae3ad231ebb6 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:03.630129 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c4eabde9-cca7-42cf-b77e-ae3ad231ebb6 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:03.630562 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c4eabde9-cca7-42cf-b77e-ae3ad231ebb6 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:03.631286 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c4eabde9-cca7-42cf-b77e-ae3ad231ebb6 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:03.631844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c4eabde9-cca7-42cf-b77e-ae3ad231ebb6 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:03.632808 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c4eabde9-cca7-42cf-b77e-ae3ad231ebb6 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:03.755110 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-779ed674-a5e3-42d8-8e7f-0c7c5dd5f184 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:07:03.755680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-779ed674-a5e3-42d8-8e7f-0c7c5dd5f184 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:03.761986 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-779ed674-a5e3-42d8-8e7f-0c7c5dd5f184 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:03.762520 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-779ed674-a5e3-42d8-8e7f-0c7c5dd5f184 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:03.762946 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-779ed674-a5e3-42d8-8e7f-0c7c5dd5f184 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:03.763643 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-779ed674-a5e3-42d8-8e7f-0c7c5dd5f184 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:03.764085 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-779ed674-a5e3-42d8-8e7f-0c7c5dd5f184 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:03.764496 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-779ed674-a5e3-42d8-8e7f-0c7c5dd5f184 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:03.787198 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c4eabde9-cca7-42cf-b77e-ae3ad231ebb6 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:03.790212 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-779ed674-a5e3-42d8-8e7f-0c7c5dd5f184 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lazy-loading 'flavor' on Instance uuid d695cc83-d3c5-44c9-af4a-2f0e67a96adf {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:07:03.798805 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c4eabde9-cca7-42cf-b77e-ae3ad231ebb6 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1364 microversion: 2.1 time: 0.181701 Sep 13 07:07:03.802198 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 387/746] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:03 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:03.840451 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-b1943ba1-8d7d-4cf8-9684-7abb835cf4ed req-a2917fc6-c0a1-4baa-85e3-013876de238b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d8a213-41c7-497e-a6a1-82dea1b238d7", "tag": "ffece28d-11d9-4c48-9e40-189550016430"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:07:03.868139 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-b1943ba1-8d7d-4cf8-9684-7abb835cf4ed req-a2917fc6-c0a1-4baa-85e3-013876de238b service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:03.868955 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-b1943ba1-8d7d-4cf8-9684-7abb835cf4ed req-a2917fc6-c0a1-4baa-85e3-013876de238b service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:03.869548 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-b1943ba1-8d7d-4cf8-9684-7abb835cf4ed req-a2917fc6-c0a1-4baa-85e3-013876de238b service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:03.898977 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-b1943ba1-8d7d-4cf8-9684-7abb835cf4ed req-a2917fc6-c0a1-4baa-85e3-013876de238b service nova] Creating event network-changed:ffece28d-11d9-4c48-9e40-189550016430 for instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 on hv-cinder-85694 Sep 13 07:07:03.907531 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-b1943ba1-8d7d-4cf8-9684-7abb835cf4ed req-a2917fc6-c0a1-4baa-85e3-013876de238b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071592 Sep 13 07:07:03.908895 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 388/747] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:07:03.939597 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-779ed674-a5e3-42d8-8e7f-0c7c5dd5f184 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "POST /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf/action" status: 202 len: 0 microversion: 2.1 time: 0.188135 Sep 13 07:07:03.940839 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 360/748] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Sep 13 07:07:03 2022] POST /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:07:03.955555 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9075a7f0-e491-4005-ae73-62046e4287c6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:03.956580 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9075a7f0-e491-4005-ae73-62046e4287c6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:03.971359 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9075a7f0-e491-4005-ae73-62046e4287c6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:03.972480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9075a7f0-e491-4005-ae73-62046e4287c6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:03.978952 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9075a7f0-e491-4005-ae73-62046e4287c6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:03.979932 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9075a7f0-e491-4005-ae73-62046e4287c6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:03.980498 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9075a7f0-e491-4005-ae73-62046e4287c6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:03.981044 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9075a7f0-e491-4005-ae73-62046e4287c6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:04.148482 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9075a7f0-e491-4005-ae73-62046e4287c6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:04.159461 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9075a7f0-e491-4005-ae73-62046e4287c6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1569 microversion: 2.1 time: 0.212615 Sep 13 07:07:04.160033 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 389/749] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:03 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:04.175891 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-df71cece-677d-45ef-ab36-b28906717a0c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:04.176699 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-df71cece-677d-45ef-ab36-b28906717a0c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:04.184114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df71cece-677d-45ef-ab36-b28906717a0c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:04.184757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df71cece-677d-45ef-ab36-b28906717a0c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:04.185295 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df71cece-677d-45ef-ab36-b28906717a0c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:04.186122 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df71cece-677d-45ef-ab36-b28906717a0c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:04.186758 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df71cece-677d-45ef-ab36-b28906717a0c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:04.190257 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df71cece-677d-45ef-ab36-b28906717a0c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:04.376881 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-df71cece-677d-45ef-ab36-b28906717a0c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:04.388980 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-df71cece-677d-45ef-ab36-b28906717a0c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:04.390609 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-df71cece-677d-45ef-ab36-b28906717a0c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:04.391919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-df71cece-677d-45ef-ab36-b28906717a0c tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1740 microversion: 2.20 time: 0.220388 Sep 13 07:07:04.392462 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 361/750] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:04 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:04.823449 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6e341288-a7d9-4138-8cfe-6cce7d5cddbf tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:04.825490 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6e341288-a7d9-4138-8cfe-6cce7d5cddbf tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:04.832692 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e341288-a7d9-4138-8cfe-6cce7d5cddbf tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:04.833177 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e341288-a7d9-4138-8cfe-6cce7d5cddbf tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:04.833791 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e341288-a7d9-4138-8cfe-6cce7d5cddbf tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:04.834979 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e341288-a7d9-4138-8cfe-6cce7d5cddbf tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:04.835700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e341288-a7d9-4138-8cfe-6cce7d5cddbf tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:04.836124 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e341288-a7d9-4138-8cfe-6cce7d5cddbf tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:04.995930 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6e341288-a7d9-4138-8cfe-6cce7d5cddbf tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:05.004332 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6e341288-a7d9-4138-8cfe-6cce7d5cddbf tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1364 microversion: 2.1 time: 0.184629 Sep 13 07:07:05.004794 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 390/751] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:04 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:07:05.187773 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7320b85c-3bc8-4724-b662-18749997ee09 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:05.188613 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7320b85c-3bc8-4724-b662-18749997ee09 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:05.195908 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7320b85c-3bc8-4724-b662-18749997ee09 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:05.196475 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7320b85c-3bc8-4724-b662-18749997ee09 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:05.196946 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7320b85c-3bc8-4724-b662-18749997ee09 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:05.197947 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7320b85c-3bc8-4724-b662-18749997ee09 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:05.198906 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7320b85c-3bc8-4724-b662-18749997ee09 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:05.199968 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7320b85c-3bc8-4724-b662-18749997ee09 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:05.351592 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7320b85c-3bc8-4724-b662-18749997ee09 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:05.360049 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7320b85c-3bc8-4724-b662-18749997ee09 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1569 microversion: 2.1 time: 0.176041 Sep 13 07:07:05.360643 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 362/752] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:05 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:05.419894 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cb57e58c-8c52-4e89-9271-e5e7d2cd75ff tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:05.420778 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cb57e58c-8c52-4e89-9271-e5e7d2cd75ff tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:05.427648 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb57e58c-8c52-4e89-9271-e5e7d2cd75ff tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:05.428208 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb57e58c-8c52-4e89-9271-e5e7d2cd75ff tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:05.428711 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb57e58c-8c52-4e89-9271-e5e7d2cd75ff tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:05.429514 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb57e58c-8c52-4e89-9271-e5e7d2cd75ff tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:05.429977 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb57e58c-8c52-4e89-9271-e5e7d2cd75ff tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:05.430874 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb57e58c-8c52-4e89-9271-e5e7d2cd75ff tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:05.956788 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cb57e58c-8c52-4e89-9271-e5e7d2cd75ff tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:05.968130 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cb57e58c-8c52-4e89-9271-e5e7d2cd75ff tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:05.969780 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cb57e58c-8c52-4e89-9271-e5e7d2cd75ff tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:05.971312 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cb57e58c-8c52-4e89-9271-e5e7d2cd75ff tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1740 microversion: 2.20 time: 0.555446 Sep 13 07:07:05.971874 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 391/753] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:05 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1740 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:06.027847 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8ec525b2-1797-4926-a4c1-33bd5183176c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:06.028468 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8ec525b2-1797-4926-a4c1-33bd5183176c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:06.035303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8ec525b2-1797-4926-a4c1-33bd5183176c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:06.035794 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8ec525b2-1797-4926-a4c1-33bd5183176c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:06.036475 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8ec525b2-1797-4926-a4c1-33bd5183176c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:06.037179 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8ec525b2-1797-4926-a4c1-33bd5183176c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:06.037798 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8ec525b2-1797-4926-a4c1-33bd5183176c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:06.038275 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8ec525b2-1797-4926-a4c1-33bd5183176c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:06.219635 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8ec525b2-1797-4926-a4c1-33bd5183176c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:06.228547 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8ec525b2-1797-4926-a4c1-33bd5183176c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1364 microversion: 2.1 time: 0.204683 Sep 13 07:07:06.229155 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 363/754] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:06 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1364 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:06.388920 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-96c00ad9-4315-4dd1-80c6-cb180778c030 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:06.389646 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-96c00ad9-4315-4dd1-80c6-cb180778c030 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:06.428692 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:06.428692 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96c00ad9-4315-4dd1-80c6-cb180778c030 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:06.428692 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96c00ad9-4315-4dd1-80c6-cb180778c030 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:06.428692 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96c00ad9-4315-4dd1-80c6-cb180778c030 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:06.439285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96c00ad9-4315-4dd1-80c6-cb180778c030 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:06.439285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96c00ad9-4315-4dd1-80c6-cb180778c030 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:06.439285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96c00ad9-4315-4dd1-80c6-cb180778c030 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:06.624935 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-96c00ad9-4315-4dd1-80c6-cb180778c030 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:06.633509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-96c00ad9-4315-4dd1-80c6-cb180778c030 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1569 microversion: 2.1 time: 0.248779 Sep 13 07:07:06.634126 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 392/755] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:06 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1569 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:06.997447 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a22d6367-6548-4324-9849-2c52cd537be7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:06.998033 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a22d6367-6548-4324-9849-2c52cd537be7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:07.005210 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a22d6367-6548-4324-9849-2c52cd537be7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:07.005745 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a22d6367-6548-4324-9849-2c52cd537be7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:07.006210 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a22d6367-6548-4324-9849-2c52cd537be7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:07.007200 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a22d6367-6548-4324-9849-2c52cd537be7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:07.007880 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a22d6367-6548-4324-9849-2c52cd537be7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:07.008492 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a22d6367-6548-4324-9849-2c52cd537be7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:07.160113 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a22d6367-6548-4324-9849-2c52cd537be7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:07.164957 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:07.171133 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a22d6367-6548-4324-9849-2c52cd537be7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:07.172960 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a22d6367-6548-4324-9849-2c52cd537be7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:07.174545 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a22d6367-6548-4324-9849-2c52cd537be7 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1740 microversion: 2.20 time: 0.181200 Sep 13 07:07:07.175524 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 364/756] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:06 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:07.253029 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-87528393-4cec-46ef-bdfc-d5c4aac80563 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:07.254624 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-87528393-4cec-46ef-bdfc-d5c4aac80563 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:07.264212 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-87528393-4cec-46ef-bdfc-d5c4aac80563 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:07.265127 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-87528393-4cec-46ef-bdfc-d5c4aac80563 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:07.265841 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-87528393-4cec-46ef-bdfc-d5c4aac80563 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:07.271011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-87528393-4cec-46ef-bdfc-d5c4aac80563 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:07.271768 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-87528393-4cec-46ef-bdfc-d5c4aac80563 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:07.272367 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-87528393-4cec-46ef-bdfc-d5c4aac80563 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:07.462582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-87528393-4cec-46ef-bdfc-d5c4aac80563 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:07.472273 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-87528393-4cec-46ef-bdfc-d5c4aac80563 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1364 microversion: 2.1 time: 0.223019 Sep 13 07:07:07.474706 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 393/757] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:07 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:07.657764 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6d4d2e94-662d-4edf-a3f2-45c6065c7c1e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:07.659040 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6d4d2e94-662d-4edf-a3f2-45c6065c7c1e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:07.667108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6d4d2e94-662d-4edf-a3f2-45c6065c7c1e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:07.670486 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6d4d2e94-662d-4edf-a3f2-45c6065c7c1e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:07.671141 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6d4d2e94-662d-4edf-a3f2-45c6065c7c1e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:07.672270 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6d4d2e94-662d-4edf-a3f2-45c6065c7c1e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:07.672703 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6d4d2e94-662d-4edf-a3f2-45c6065c7c1e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:07.673115 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6d4d2e94-662d-4edf-a3f2-45c6065c7c1e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:07.828358 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6d4d2e94-662d-4edf-a3f2-45c6065c7c1e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:07.838618 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6d4d2e94-662d-4edf-a3f2-45c6065c7c1e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1569 microversion: 2.1 time: 0.184494 Sep 13 07:07:07.854170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-5cf52914-fd74-4c8a-9af8-69620a400b3d req-e4b8666e-0ed8-4e92-9406-500b8a3c7d6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d8a213-41c7-497e-a6a1-82dea1b238d7", "name": "network-vif-plugged", "status": "completed", "tag": "ffece28d-11d9-4c48-9e40-189550016430"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:07:07.855111 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 365/758] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:07 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:07.864396 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-5cf52914-fd74-4c8a-9af8-69620a400b3d req-e4b8666e-0ed8-4e92-9406-500b8a3c7d6e service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:07.864978 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-5cf52914-fd74-4c8a-9af8-69620a400b3d req-e4b8666e-0ed8-4e92-9406-500b8a3c7d6e service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:07.865472 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-5cf52914-fd74-4c8a-9af8-69620a400b3d req-e4b8666e-0ed8-4e92-9406-500b8a3c7d6e service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:07.885055 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-5cf52914-fd74-4c8a-9af8-69620a400b3d req-e4b8666e-0ed8-4e92-9406-500b8a3c7d6e service nova] Creating event network-vif-plugged:ffece28d-11d9-4c48-9e40-189550016430 for instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 on hv-cinder-85694 Sep 13 07:07:07.890373 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-5cf52914-fd74-4c8a-9af8-69620a400b3d req-e4b8666e-0ed8-4e92-9406-500b8a3c7d6e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045267 Sep 13 07:07:07.891494 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 394/759] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:07:08.203338 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c19b7f0f-6f21-4002-bd5f-5f3d7209139d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:08.203940 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c19b7f0f-6f21-4002-bd5f-5f3d7209139d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:08.210909 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c19b7f0f-6f21-4002-bd5f-5f3d7209139d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:08.211391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c19b7f0f-6f21-4002-bd5f-5f3d7209139d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:08.211815 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c19b7f0f-6f21-4002-bd5f-5f3d7209139d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:08.212504 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c19b7f0f-6f21-4002-bd5f-5f3d7209139d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:08.212948 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c19b7f0f-6f21-4002-bd5f-5f3d7209139d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:08.213361 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c19b7f0f-6f21-4002-bd5f-5f3d7209139d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:08.363391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c19b7f0f-6f21-4002-bd5f-5f3d7209139d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:08.373206 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c19b7f0f-6f21-4002-bd5f-5f3d7209139d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:08.375122 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c19b7f0f-6f21-4002-bd5f-5f3d7209139d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:08.376452 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c19b7f0f-6f21-4002-bd5f-5f3d7209139d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1740 microversion: 2.20 time: 0.177082 Sep 13 07:07:08.377194 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 366/760] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:08 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:08.448065 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a9795e31-bbea-4a02-999e-90a3c05421d5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:08.449271 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a9795e31-bbea-4a02-999e-90a3c05421d5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:08.455910 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a9795e31-bbea-4a02-999e-90a3c05421d5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:08.456765 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a9795e31-bbea-4a02-999e-90a3c05421d5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:08.457409 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a9795e31-bbea-4a02-999e-90a3c05421d5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:08.457901 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a9795e31-bbea-4a02-999e-90a3c05421d5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:08.458379 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a9795e31-bbea-4a02-999e-90a3c05421d5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:08.458955 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a9795e31-bbea-4a02-999e-90a3c05421d5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:08.485289 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a9795e31-bbea-4a02-999e-90a3c05421d5 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56/ips" status: 200 len: 149 microversion: 2.1 time: 0.042184 Sep 13 07:07:08.486195 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 395/761] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Sep 13 07:07:08 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:07:08.496876 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8b88bf21-ff91-4957-a934-20f575ecd383 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:08.497482 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8b88bf21-ff91-4957-a934-20f575ecd383 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:08.512098 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b88bf21-ff91-4957-a934-20f575ecd383 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:08.514937 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b88bf21-ff91-4957-a934-20f575ecd383 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:08.514937 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b88bf21-ff91-4957-a934-20f575ecd383 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:08.514937 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b88bf21-ff91-4957-a934-20f575ecd383 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:08.514937 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b88bf21-ff91-4957-a934-20f575ecd383 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:08.518479 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b88bf21-ff91-4957-a934-20f575ecd383 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:08.685757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8b88bf21-ff91-4957-a934-20f575ecd383 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:08.701794 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8b88bf21-ff91-4957-a934-20f575ecd383 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1364 microversion: 2.1 time: 0.205220 Sep 13 07:07:08.714111 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 367/762] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:08 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:08.867597 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-93fb57bd-83a3-40e5-bf50-25774c5d9176 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:08.868742 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-93fb57bd-83a3-40e5-bf50-25774c5d9176 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:08.878028 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-93fb57bd-83a3-40e5-bf50-25774c5d9176 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:08.878533 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-93fb57bd-83a3-40e5-bf50-25774c5d9176 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:08.878957 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-93fb57bd-83a3-40e5-bf50-25774c5d9176 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:08.879647 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-93fb57bd-83a3-40e5-bf50-25774c5d9176 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:08.880108 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-93fb57bd-83a3-40e5-bf50-25774c5d9176 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:08.883620 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-93fb57bd-83a3-40e5-bf50-25774c5d9176 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:09.054607 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-93fb57bd-83a3-40e5-bf50-25774c5d9176 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:09.065302 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-93fb57bd-83a3-40e5-bf50-25774c5d9176 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1569 microversion: 2.1 time: 0.201876 Sep 13 07:07:09.065969 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 396/763] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:08 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:09.401955 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3553b382-c8e5-4085-97b9-114a27d877ef tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:09.402726 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3553b382-c8e5-4085-97b9-114a27d877ef tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:09.409839 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3553b382-c8e5-4085-97b9-114a27d877ef tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:09.410359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3553b382-c8e5-4085-97b9-114a27d877ef tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:09.410772 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3553b382-c8e5-4085-97b9-114a27d877ef tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:09.411478 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3553b382-c8e5-4085-97b9-114a27d877ef tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:09.411922 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3553b382-c8e5-4085-97b9-114a27d877ef tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:09.412337 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3553b382-c8e5-4085-97b9-114a27d877ef tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:09.568864 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3553b382-c8e5-4085-97b9-114a27d877ef tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:09.585928 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3553b382-c8e5-4085-97b9-114a27d877ef tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:09.588257 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3553b382-c8e5-4085-97b9-114a27d877ef tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:09.590176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3553b382-c8e5-4085-97b9-114a27d877ef tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1740 microversion: 2.20 time: 0.192338 Sep 13 07:07:09.596039 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 368/764] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:09 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:07:09.733479 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f69615d8-b597-4451-ac1b-d9e2d4d22d19 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:09.734107 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f69615d8-b597-4451-ac1b-d9e2d4d22d19 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:09.741247 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f69615d8-b597-4451-ac1b-d9e2d4d22d19 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:09.742262 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f69615d8-b597-4451-ac1b-d9e2d4d22d19 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:09.743137 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f69615d8-b597-4451-ac1b-d9e2d4d22d19 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:09.744074 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f69615d8-b597-4451-ac1b-d9e2d4d22d19 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:09.744536 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f69615d8-b597-4451-ac1b-d9e2d4d22d19 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:09.744956 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f69615d8-b597-4451-ac1b-d9e2d4d22d19 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:09.899729 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f69615d8-b597-4451-ac1b-d9e2d4d22d19 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:09.909323 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f69615d8-b597-4451-ac1b-d9e2d4d22d19 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1364 microversion: 2.1 time: 0.184836 Sep 13 07:07:09.909900 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 397/765] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:09 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:10.023085 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7db65b61-bd8e-424b-aa7e-99cda3aa4042 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76df190d-656b-490d-a0cf-ffe43db0bad4"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:07:10.033473 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7db65b61-bd8e-424b-aa7e-99cda3aa4042 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:10.043270 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7db65b61-bd8e-424b-aa7e-99cda3aa4042 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:10.043982 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7db65b61-bd8e-424b-aa7e-99cda3aa4042 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:10.044581 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7db65b61-bd8e-424b-aa7e-99cda3aa4042 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:10.045481 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7db65b61-bd8e-424b-aa7e-99cda3aa4042 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:10.046213 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7db65b61-bd8e-424b-aa7e-99cda3aa4042 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:10.046801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7db65b61-bd8e-424b-aa7e-99cda3aa4042 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:10.090700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4a2e431c-e34c-44f1-b01f-7f7e3fbfc94e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:10.091486 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4a2e431c-e34c-44f1-b01f-7f7e3fbfc94e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:10.105974 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4a2e431c-e34c-44f1-b01f-7f7e3fbfc94e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:10.106549 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4a2e431c-e34c-44f1-b01f-7f7e3fbfc94e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:10.106994 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4a2e431c-e34c-44f1-b01f-7f7e3fbfc94e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:10.110288 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4a2e431c-e34c-44f1-b01f-7f7e3fbfc94e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:10.110788 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4a2e431c-e34c-44f1-b01f-7f7e3fbfc94e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:10.111232 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4a2e431c-e34c-44f1-b01f-7f7e3fbfc94e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:10.134699 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:10.260266 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4a2e431c-e34c-44f1-b01f-7f7e3fbfc94e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:10.268840 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4a2e431c-e34c-44f1-b01f-7f7e3fbfc94e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1569 microversion: 2.1 time: 0.183306 Sep 13 07:07:10.286385 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 398/766] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:10 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:07:10.404073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7db65b61-bd8e-424b-aa7e-99cda3aa4042 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "POST /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.386477 Sep 13 07:07:10.404594 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 369/767] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Sep 13 07:07:10 2022] POST /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:07:10.616933 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-72022692-fcd2-41b6-98cc-06929e3e1ee4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:10.617558 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-72022692-fcd2-41b6-98cc-06929e3e1ee4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:10.619463 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=12 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:10.625437 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72022692-fcd2-41b6-98cc-06929e3e1ee4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:10.625916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72022692-fcd2-41b6-98cc-06929e3e1ee4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:10.626366 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72022692-fcd2-41b6-98cc-06929e3e1ee4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:10.627054 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72022692-fcd2-41b6-98cc-06929e3e1ee4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:10.627500 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72022692-fcd2-41b6-98cc-06929e3e1ee4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:10.627898 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72022692-fcd2-41b6-98cc-06929e3e1ee4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:10.646742 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:10.769555 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-72022692-fcd2-41b6-98cc-06929e3e1ee4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:10.778335 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-72022692-fcd2-41b6-98cc-06929e3e1ee4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:10.779857 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-72022692-fcd2-41b6-98cc-06929e3e1ee4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:10.781102 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-72022692-fcd2-41b6-98cc-06929e3e1ee4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1740 microversion: 2.20 time: 0.168082 Sep 13 07:07:10.781660 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 399/768] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:10 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:10.934151 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9ad2cf41-7618-42d3-a4b1-82a7f8084be4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:10.934951 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9ad2cf41-7618-42d3-a4b1-82a7f8084be4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:10.943034 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ad2cf41-7618-42d3-a4b1-82a7f8084be4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:10.943624 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ad2cf41-7618-42d3-a4b1-82a7f8084be4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:10.944058 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ad2cf41-7618-42d3-a4b1-82a7f8084be4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:10.944748 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ad2cf41-7618-42d3-a4b1-82a7f8084be4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:10.945207 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ad2cf41-7618-42d3-a4b1-82a7f8084be4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:10.945614 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ad2cf41-7618-42d3-a4b1-82a7f8084be4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:11.076318 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9ad2cf41-7618-42d3-a4b1-82a7f8084be4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:11.084172 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9ad2cf41-7618-42d3-a4b1-82a7f8084be4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1550 microversion: 2.1 time: 0.155472 Sep 13 07:07:11.084749 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 370/769] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:10 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:11.106376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d26618f2-267e-41a3-adcd-bd6301141e72 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:11.106863 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d26618f2-267e-41a3-adcd-bd6301141e72 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:11.112965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d26618f2-267e-41a3-adcd-bd6301141e72 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:11.113521 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d26618f2-267e-41a3-adcd-bd6301141e72 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:11.113950 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d26618f2-267e-41a3-adcd-bd6301141e72 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:11.114673 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d26618f2-267e-41a3-adcd-bd6301141e72 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:11.115125 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d26618f2-267e-41a3-adcd-bd6301141e72 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:11.115548 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d26618f2-267e-41a3-adcd-bd6301141e72 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:11.230159 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d26618f2-267e-41a3-adcd-bd6301141e72 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127459 Sep 13 07:07:11.231023 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 400/770] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Sep 13 07:07:11 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:07:11.294230 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2b929d8c-be6c-4542-be0f-8dcc08011a00 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:11.295268 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2b929d8c-be6c-4542-be0f-8dcc08011a00 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:11.306237 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b929d8c-be6c-4542-be0f-8dcc08011a00 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:11.306732 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b929d8c-be6c-4542-be0f-8dcc08011a00 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:11.307609 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b929d8c-be6c-4542-be0f-8dcc08011a00 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:11.308507 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b929d8c-be6c-4542-be0f-8dcc08011a00 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:11.309143 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b929d8c-be6c-4542-be0f-8dcc08011a00 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:11.309559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b929d8c-be6c-4542-be0f-8dcc08011a00 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:11.545395 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2b929d8c-be6c-4542-be0f-8dcc08011a00 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:11.557338 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2b929d8c-be6c-4542-be0f-8dcc08011a00 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1569 microversion: 2.1 time: 0.267423 Sep 13 07:07:11.569608 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 371/771] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:11 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1569 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:11.809383 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ada7d965-9d6b-446f-a904-1a3aed7422a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:11.809987 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ada7d965-9d6b-446f-a904-1a3aed7422a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:11.816049 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ada7d965-9d6b-446f-a904-1a3aed7422a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:11.816534 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ada7d965-9d6b-446f-a904-1a3aed7422a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:11.816960 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ada7d965-9d6b-446f-a904-1a3aed7422a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:11.817657 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ada7d965-9d6b-446f-a904-1a3aed7422a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:11.818118 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ada7d965-9d6b-446f-a904-1a3aed7422a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:11.818725 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ada7d965-9d6b-446f-a904-1a3aed7422a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:11.959891 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ada7d965-9d6b-446f-a904-1a3aed7422a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:11.968976 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ada7d965-9d6b-446f-a904-1a3aed7422a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:11.970632 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ada7d965-9d6b-446f-a904-1a3aed7422a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:11.971901 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ada7d965-9d6b-446f-a904-1a3aed7422a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1722 microversion: 2.20 time: 0.169285 Sep 13 07:07:11.972546 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 401/772] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:11 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:12.571350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-26f123b5-2422-45b6-ae86-0f9f66076c64 req-8b974ffe-ac76-442f-874b-abb3a5dcd900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d8a213-41c7-497e-a6a1-82dea1b238d7", "tag": "ffece28d-11d9-4c48-9e40-189550016430"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:07:12.580918 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-32b0ea9a-637d-41da-b713-25ced37aa069 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:12.581346 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-32b0ea9a-637d-41da-b713-25ced37aa069 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:12.583522 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-26f123b5-2422-45b6-ae86-0f9f66076c64 req-8b974ffe-ac76-442f-874b-abb3a5dcd900 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:12.584117 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-26f123b5-2422-45b6-ae86-0f9f66076c64 req-8b974ffe-ac76-442f-874b-abb3a5dcd900 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:12.584819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-26f123b5-2422-45b6-ae86-0f9f66076c64 req-8b974ffe-ac76-442f-874b-abb3a5dcd900 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:12.588560 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32b0ea9a-637d-41da-b713-25ced37aa069 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:12.589128 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32b0ea9a-637d-41da-b713-25ced37aa069 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:12.589665 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32b0ea9a-637d-41da-b713-25ced37aa069 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:12.590461 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32b0ea9a-637d-41da-b713-25ced37aa069 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:12.591859 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32b0ea9a-637d-41da-b713-25ced37aa069 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:12.598259 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-26f123b5-2422-45b6-ae86-0f9f66076c64 req-8b974ffe-ac76-442f-874b-abb3a5dcd900 service nova] Creating event network-changed:ffece28d-11d9-4c48-9e40-189550016430 for instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 on hv-cinder-85694 Sep 13 07:07:12.600115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32b0ea9a-637d-41da-b713-25ced37aa069 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:12.604693 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-26f123b5-2422-45b6-ae86-0f9f66076c64 req-8b974ffe-ac76-442f-874b-abb3a5dcd900 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037239 Sep 13 07:07:12.605344 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 372/773] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:07:12.750658 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-32b0ea9a-637d-41da-b713-25ced37aa069 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:12.760158 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-32b0ea9a-637d-41da-b713-25ced37aa069 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1569 microversion: 2.1 time: 0.183258 Sep 13 07:07:12.761134 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 402/774] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:12 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:07:12.998444 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7fc240ac-368b-453b-a637-a6b858306801 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:12.999126 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7fc240ac-368b-453b-a637-a6b858306801 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:13.005581 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7fc240ac-368b-453b-a637-a6b858306801 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:13.006048 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7fc240ac-368b-453b-a637-a6b858306801 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:13.006499 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7fc240ac-368b-453b-a637-a6b858306801 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:13.007263 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7fc240ac-368b-453b-a637-a6b858306801 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:13.007728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7fc240ac-368b-453b-a637-a6b858306801 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:13.008259 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7fc240ac-368b-453b-a637-a6b858306801 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:13.140221 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7fc240ac-368b-453b-a637-a6b858306801 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:13.148827 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7fc240ac-368b-453b-a637-a6b858306801 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:13.150333 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7fc240ac-368b-453b-a637-a6b858306801 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:13.151616 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7fc240ac-368b-453b-a637-a6b858306801 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1722 microversion: 2.20 time: 0.157584 Sep 13 07:07:13.152192 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 373/775] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:12 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:13.771787 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-371408cc-6999-4e53-ba04-2eafe12efc49 req-a5c0cc09-9cf6-41b1-b57c-b49a0d434d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1166e7-c092-4bde-b87c-cb8aaa1918da", "name": "network-vif-unplugged", "status": "completed", "tag": "dc830de4-1081-4c18-ada7-433d5588216c"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:07:13.782338 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-371408cc-6999-4e53-ba04-2eafe12efc49 req-a5c0cc09-9cf6-41b1-b57c-b49a0d434d9d service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:13.782844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-371408cc-6999-4e53-ba04-2eafe12efc49 req-a5c0cc09-9cf6-41b1-b57c-b49a0d434d9d service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:13.783219 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-371408cc-6999-4e53-ba04-2eafe12efc49 req-a5c0cc09-9cf6-41b1-b57c-b49a0d434d9d service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:13.784049 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6f3d8d03-5a42-4970-9c93-f0690bd6fd3d tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:13.784833 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6f3d8d03-5a42-4970-9c93-f0690bd6fd3d tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:13.792396 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f3d8d03-5a42-4970-9c93-f0690bd6fd3d tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:13.792975 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f3d8d03-5a42-4970-9c93-f0690bd6fd3d tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:13.793472 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f3d8d03-5a42-4970-9c93-f0690bd6fd3d tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:13.794272 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f3d8d03-5a42-4970-9c93-f0690bd6fd3d tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:13.794783 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f3d8d03-5a42-4970-9c93-f0690bd6fd3d tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:13.795282 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f3d8d03-5a42-4970-9c93-f0690bd6fd3d tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:13.795628 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-371408cc-6999-4e53-ba04-2eafe12efc49 req-a5c0cc09-9cf6-41b1-b57c-b49a0d434d9d service nova] Creating event network-vif-unplugged:dc830de4-1081-4c18-ada7-433d5588216c for instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da on hv-cinder-85694 Sep 13 07:07:13.800691 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-371408cc-6999-4e53-ba04-2eafe12efc49 req-a5c0cc09-9cf6-41b1-b57c-b49a0d434d9d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032867 Sep 13 07:07:13.801475 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 403/776] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:07:13.978366 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6f3d8d03-5a42-4970-9c93-f0690bd6fd3d tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:13.986383 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6f3d8d03-5a42-4970-9c93-f0690bd6fd3d tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1569 microversion: 2.1 time: 0.206631 Sep 13 07:07:13.986967 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 374/777] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:13 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1569 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:14.177666 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a981f1c0-4d50-40e8-9786-dd5f264a17a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:14.178454 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a981f1c0-4d50-40e8-9786-dd5f264a17a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:14.185449 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a981f1c0-4d50-40e8-9786-dd5f264a17a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:14.185925 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a981f1c0-4d50-40e8-9786-dd5f264a17a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:14.186392 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a981f1c0-4d50-40e8-9786-dd5f264a17a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:14.187078 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a981f1c0-4d50-40e8-9786-dd5f264a17a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:14.187521 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a981f1c0-4d50-40e8-9786-dd5f264a17a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:14.187932 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a981f1c0-4d50-40e8-9786-dd5f264a17a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:14.332564 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a981f1c0-4d50-40e8-9786-dd5f264a17a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:14.341092 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a981f1c0-4d50-40e8-9786-dd5f264a17a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:14.342633 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a981f1c0-4d50-40e8-9786-dd5f264a17a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:14.343813 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a981f1c0-4d50-40e8-9786-dd5f264a17a6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1725 microversion: 2.20 time: 0.170919 Sep 13 07:07:14.344376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 404/778] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:14 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:14.368852 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a5b100ab-d5f4-4500-896b-9fcd21ed3bf4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71bf4352-d093-4091-bec3-2f9530328de2"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:07:14.371259 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a5b100ab-d5f4-4500-896b-9fcd21ed3bf4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:14.377213 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a5b100ab-d5f4-4500-896b-9fcd21ed3bf4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:14.377690 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a5b100ab-d5f4-4500-896b-9fcd21ed3bf4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:14.378199 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a5b100ab-d5f4-4500-896b-9fcd21ed3bf4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:14.378876 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a5b100ab-d5f4-4500-896b-9fcd21ed3bf4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:14.379322 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a5b100ab-d5f4-4500-896b-9fcd21ed3bf4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:14.379731 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a5b100ab-d5f4-4500-896b-9fcd21ed3bf4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:14.759721 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a5b100ab-d5f4-4500-896b-9fcd21ed3bf4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "POST /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.395050 Sep 13 07:07:14.760418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 375/779] 10.222.0.25 () {62 vars in 1364 bytes} [Tue Sep 13 07:07:14 2022] POST /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da/os-volume_attachments => generated 188 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:07:14.893350 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ec6de439-20f1-42dc-8e75-5068095bf696 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:14.893863 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ec6de439-20f1-42dc-8e75-5068095bf696 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:14.902240 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ec6de439-20f1-42dc-8e75-5068095bf696 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:14.902728 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ec6de439-20f1-42dc-8e75-5068095bf696 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:14.903155 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ec6de439-20f1-42dc-8e75-5068095bf696 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:14.903851 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ec6de439-20f1-42dc-8e75-5068095bf696 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:14.904301 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ec6de439-20f1-42dc-8e75-5068095bf696 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:14.904716 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ec6de439-20f1-42dc-8e75-5068095bf696 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:15.011397 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c7d64b80-323b-4ebc-a71a-2c95225d52eb tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:15.012051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c7d64b80-323b-4ebc-a71a-2c95225d52eb tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:15.018268 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7d64b80-323b-4ebc-a71a-2c95225d52eb tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:15.018914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7d64b80-323b-4ebc-a71a-2c95225d52eb tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:15.019349 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7d64b80-323b-4ebc-a71a-2c95225d52eb tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:15.020051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7d64b80-323b-4ebc-a71a-2c95225d52eb tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:15.020501 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7d64b80-323b-4ebc-a71a-2c95225d52eb tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:15.021043 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7d64b80-323b-4ebc-a71a-2c95225d52eb tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:15.169329 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c7d64b80-323b-4ebc-a71a-2c95225d52eb tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:15.177606 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c7d64b80-323b-4ebc-a71a-2c95225d52eb tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1569 microversion: 2.1 time: 0.171170 Sep 13 07:07:15.178292 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 376/780] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:15 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:15.185564 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ec6de439-20f1-42dc-8e75-5068095bf696 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da/os-volume_attachments/71bf4352-d093-4091-bec3-2f9530328de2" status: 202 len: 0 microversion: 2.20 time: 0.296143 Sep 13 07:07:15.186598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 405/781] 10.222.0.25 () {60 vars in 1457 bytes} [Tue Sep 13 07:07:14 2022] DELETE /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da/os-volume_attachments/71bf4352-d093-4091-bec3-2f9530328de2 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:07:15.251907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3a15c793-6a0c-49aa-8345-df125dec8410 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:07:15.252759 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3a15c793-6a0c-49aa-8345-df125dec8410 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:15.260369 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a15c793-6a0c-49aa-8345-df125dec8410 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:15.260855 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a15c793-6a0c-49aa-8345-df125dec8410 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:15.261294 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a15c793-6a0c-49aa-8345-df125dec8410 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:15.261986 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a15c793-6a0c-49aa-8345-df125dec8410 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:15.262463 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a15c793-6a0c-49aa-8345-df125dec8410 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:15.262883 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a15c793-6a0c-49aa-8345-df125dec8410 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:15.306295 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3a15c793-6a0c-49aa-8345-df125dec8410 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120695) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 07:07:15.351465 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:15.385476 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3a15c793-6a0c-49aa-8345-df125dec8410 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "POST /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da/action" status: 202 len: 0 microversion: 2.20 time: 0.140208 Sep 13 07:07:15.385995 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 377/782] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Sep 13 07:07:15 2022] POST /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:07:15.394160 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-13b7b004-1f63-4568-a64d-8f8da775d4fc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:15.394750 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-13b7b004-1f63-4568-a64d-8f8da775d4fc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:15.401011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13b7b004-1f63-4568-a64d-8f8da775d4fc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:15.401491 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13b7b004-1f63-4568-a64d-8f8da775d4fc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:15.401909 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13b7b004-1f63-4568-a64d-8f8da775d4fc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:15.402620 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13b7b004-1f63-4568-a64d-8f8da775d4fc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:15.403062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13b7b004-1f63-4568-a64d-8f8da775d4fc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:15.403473 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13b7b004-1f63-4568-a64d-8f8da775d4fc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:15.535977 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-13b7b004-1f63-4568-a64d-8f8da775d4fc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:15.544611 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-13b7b004-1f63-4568-a64d-8f8da775d4fc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:15.546029 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-13b7b004-1f63-4568-a64d-8f8da775d4fc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:15.547379 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-13b7b004-1f63-4568-a64d-8f8da775d4fc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1673 microversion: 2.20 time: 0.157176 Sep 13 07:07:15.557293 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 406/783] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:15 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:16.203523 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-07b9798f-1d35-47f7-a76d-0cd83cb51982 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:16.204150 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-07b9798f-1d35-47f7-a76d-0cd83cb51982 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:16.210278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-07b9798f-1d35-47f7-a76d-0cd83cb51982 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:16.211390 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-07b9798f-1d35-47f7-a76d-0cd83cb51982 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:16.211693 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-07b9798f-1d35-47f7-a76d-0cd83cb51982 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:16.212387 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-07b9798f-1d35-47f7-a76d-0cd83cb51982 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:16.212845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-07b9798f-1d35-47f7-a76d-0cd83cb51982 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:16.213258 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-07b9798f-1d35-47f7-a76d-0cd83cb51982 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:16.359537 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-07b9798f-1d35-47f7-a76d-0cd83cb51982 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:16.367857 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-07b9798f-1d35-47f7-a76d-0cd83cb51982 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1569 microversion: 2.1 time: 0.168890 Sep 13 07:07:16.368465 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 378/784] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:16 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:16.575210 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b1a0c2b3-a9f4-42f1-981a-7c77045ab258 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:16.575817 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b1a0c2b3-a9f4-42f1-981a-7c77045ab258 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:16.582606 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b1a0c2b3-a9f4-42f1-981a-7c77045ab258 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:16.583131 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b1a0c2b3-a9f4-42f1-981a-7c77045ab258 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:16.583565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b1a0c2b3-a9f4-42f1-981a-7c77045ab258 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:16.584287 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b1a0c2b3-a9f4-42f1-981a-7c77045ab258 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:16.584733 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b1a0c2b3-a9f4-42f1-981a-7c77045ab258 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:16.585141 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b1a0c2b3-a9f4-42f1-981a-7c77045ab258 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:16.721974 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b1a0c2b3-a9f4-42f1-981a-7c77045ab258 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:16.730516 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b1a0c2b3-a9f4-42f1-981a-7c77045ab258 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:16.731958 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b1a0c2b3-a9f4-42f1-981a-7c77045ab258 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:16.733134 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b1a0c2b3-a9f4-42f1-981a-7c77045ab258 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1673 microversion: 2.20 time: 0.163081 Sep 13 07:07:16.733696 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 407/785] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:16 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:17.391522 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2fd30e5c-6b10-40f8-a698-644d217fcc6f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:17.392122 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2fd30e5c-6b10-40f8-a698-644d217fcc6f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:17.398520 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2fd30e5c-6b10-40f8-a698-644d217fcc6f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:17.399036 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2fd30e5c-6b10-40f8-a698-644d217fcc6f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:17.399486 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2fd30e5c-6b10-40f8-a698-644d217fcc6f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:17.400176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2fd30e5c-6b10-40f8-a698-644d217fcc6f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:17.400621 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2fd30e5c-6b10-40f8-a698-644d217fcc6f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:17.401035 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2fd30e5c-6b10-40f8-a698-644d217fcc6f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:17.563343 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2fd30e5c-6b10-40f8-a698-644d217fcc6f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:17.571300 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2fd30e5c-6b10-40f8-a698-644d217fcc6f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1569 microversion: 2.1 time: 0.183961 Sep 13 07:07:17.571896 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 379/786] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:17 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:07:17.759437 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-05b8f472-cc3c-4c10-b400-f8e62fa7d9d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:17.760131 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-05b8f472-cc3c-4c10-b400-f8e62fa7d9d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:17.766436 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-05b8f472-cc3c-4c10-b400-f8e62fa7d9d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:17.767000 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-05b8f472-cc3c-4c10-b400-f8e62fa7d9d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:17.767401 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-05b8f472-cc3c-4c10-b400-f8e62fa7d9d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:17.768126 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-05b8f472-cc3c-4c10-b400-f8e62fa7d9d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:17.768666 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-05b8f472-cc3c-4c10-b400-f8e62fa7d9d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:17.769033 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-05b8f472-cc3c-4c10-b400-f8e62fa7d9d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:17.917893 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-05b8f472-cc3c-4c10-b400-f8e62fa7d9d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:17.926543 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-05b8f472-cc3c-4c10-b400-f8e62fa7d9d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:17.928045 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-05b8f472-cc3c-4c10-b400-f8e62fa7d9d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:17.929204 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-05b8f472-cc3c-4c10-b400-f8e62fa7d9d9 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1731 microversion: 2.20 time: 0.174091 Sep 13 07:07:17.931347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 408/787] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:17 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:18.135027 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d52d6ed4-67c9-4175-bfee-2c2aa15ba8fd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:18.135515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d52d6ed4-67c9-4175-bfee-2c2aa15ba8fd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:18.142051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d52d6ed4-67c9-4175-bfee-2c2aa15ba8fd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:18.142493 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d52d6ed4-67c9-4175-bfee-2c2aa15ba8fd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:18.142974 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d52d6ed4-67c9-4175-bfee-2c2aa15ba8fd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:18.143783 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d52d6ed4-67c9-4175-bfee-2c2aa15ba8fd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:18.144322 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d52d6ed4-67c9-4175-bfee-2c2aa15ba8fd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:18.144911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d52d6ed4-67c9-4175-bfee-2c2aa15ba8fd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:18.234319 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-d52d6ed4-67c9-4175-bfee-2c2aa15ba8fd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lazy-loading 'services' on Instance uuid e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:07:18.312742 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d52d6ed4-67c9-4175-bfee-2c2aa15ba8fd tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56/os-volume_attachments/76df190d-656b-490d-a0cf-ffe43db0bad4" status: 202 len: 0 microversion: 2.1 time: 0.181528 Sep 13 07:07:18.313330 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 380/788] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Sep 13 07:07:18 2022] DELETE /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56/os-volume_attachments/76df190d-656b-490d-a0cf-ffe43db0bad4 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:07:18.325889 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-82dd47de-386b-419a-af95-a967a71377f2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:18.329223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-82dd47de-386b-419a-af95-a967a71377f2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:18.337692 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82dd47de-386b-419a-af95-a967a71377f2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:18.338229 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82dd47de-386b-419a-af95-a967a71377f2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:18.338656 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82dd47de-386b-419a-af95-a967a71377f2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:18.339335 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82dd47de-386b-419a-af95-a967a71377f2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:18.339825 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82dd47de-386b-419a-af95-a967a71377f2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:18.340265 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82dd47de-386b-419a-af95-a967a71377f2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:18.371093 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-82dd47de-386b-419a-af95-a967a71377f2 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051296 Sep 13 07:07:18.371680 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 409/789] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Sep 13 07:07:18 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:07:18.596332 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-82af6b05-f113-4590-aa2e-1087cb688124 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:18.597318 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-82af6b05-f113-4590-aa2e-1087cb688124 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:18.609788 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82af6b05-f113-4590-aa2e-1087cb688124 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:18.610312 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82af6b05-f113-4590-aa2e-1087cb688124 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:18.610743 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82af6b05-f113-4590-aa2e-1087cb688124 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:18.611461 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82af6b05-f113-4590-aa2e-1087cb688124 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:18.611911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82af6b05-f113-4590-aa2e-1087cb688124 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:18.612583 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82af6b05-f113-4590-aa2e-1087cb688124 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:18.750050 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-82af6b05-f113-4590-aa2e-1087cb688124 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:18.760438 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-82af6b05-f113-4590-aa2e-1087cb688124 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1510 microversion: 2.1 time: 0.168831 Sep 13 07:07:18.761085 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 381/790] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:18 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:18.782631 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d8f11408-4bb2-440d-a7a3-bc1fee89636b tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:07:18.783213 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d8f11408-4bb2-440d-a7a3-bc1fee89636b tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:18.789905 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8f11408-4bb2-440d-a7a3-bc1fee89636b tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:18.790452 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8f11408-4bb2-440d-a7a3-bc1fee89636b tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:18.790877 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8f11408-4bb2-440d-a7a3-bc1fee89636b tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:18.791551 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8f11408-4bb2-440d-a7a3-bc1fee89636b tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:18.791990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8f11408-4bb2-440d-a7a3-bc1fee89636b tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:18.792430 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8f11408-4bb2-440d-a7a3-bc1fee89636b tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:18.822363 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d8f11408-4bb2-440d-a7a3-bc1fee89636b tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120696) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 07:07:18.892806 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d8f11408-4bb2-440d-a7a3-bc1fee89636b tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "POST /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf/action" status: 202 len: 0 microversion: 2.1 time: 0.114005 Sep 13 07:07:18.893400 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 410/791] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Sep 13 07:07:18 2022] POST /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:07:18.902242 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-27aebc1e-75d9-4f9b-a5ef-b8ad491c0c6f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:18.903021 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-27aebc1e-75d9-4f9b-a5ef-b8ad491c0c6f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:18.909297 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-27aebc1e-75d9-4f9b-a5ef-b8ad491c0c6f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:18.910001 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-27aebc1e-75d9-4f9b-a5ef-b8ad491c0c6f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:18.910612 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-27aebc1e-75d9-4f9b-a5ef-b8ad491c0c6f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:18.911468 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-27aebc1e-75d9-4f9b-a5ef-b8ad491c0c6f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:18.912071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-27aebc1e-75d9-4f9b-a5ef-b8ad491c0c6f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:18.913156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-27aebc1e-75d9-4f9b-a5ef-b8ad491c0c6f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:18.957301 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1141a6d8-ad70-49f1-a231-61c4843e42f0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:18.957877 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1141a6d8-ad70-49f1-a231-61c4843e42f0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:18.965106 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1141a6d8-ad70-49f1-a231-61c4843e42f0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:18.965598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1141a6d8-ad70-49f1-a231-61c4843e42f0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:18.966102 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1141a6d8-ad70-49f1-a231-61c4843e42f0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:18.966810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1141a6d8-ad70-49f1-a231-61c4843e42f0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:18.967260 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1141a6d8-ad70-49f1-a231-61c4843e42f0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:18.967677 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1141a6d8-ad70-49f1-a231-61c4843e42f0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:19.130640 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-27aebc1e-75d9-4f9b-a5ef-b8ad491c0c6f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:19.141285 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-27aebc1e-75d9-4f9b-a5ef-b8ad491c0c6f tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1518 microversion: 2.1 time: 0.243292 Sep 13 07:07:19.142383 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 382/792] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:18 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1518 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:19.157318 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1141a6d8-ad70-49f1-a231-61c4843e42f0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:19.166790 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1141a6d8-ad70-49f1-a231-61c4843e42f0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:19.168255 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1141a6d8-ad70-49f1-a231-61c4843e42f0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:19.170400 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1141a6d8-ad70-49f1-a231-61c4843e42f0 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1731 microversion: 2.20 time: 0.217411 Sep 13 07:07:19.171136 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 411/793] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:18 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:07:19.384162 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-699dee2c-d3c3-4446-97ef-1632c6ba48c6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:19.386435 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-699dee2c-d3c3-4446-97ef-1632c6ba48c6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:19.392584 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-699dee2c-d3c3-4446-97ef-1632c6ba48c6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:19.393086 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-699dee2c-d3c3-4446-97ef-1632c6ba48c6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:19.393542 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-699dee2c-d3c3-4446-97ef-1632c6ba48c6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:19.394371 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-699dee2c-d3c3-4446-97ef-1632c6ba48c6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:19.394824 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-699dee2c-d3c3-4446-97ef-1632c6ba48c6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:19.395262 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-699dee2c-d3c3-4446-97ef-1632c6ba48c6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:19.432652 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-699dee2c-d3c3-4446-97ef-1632c6ba48c6 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052556 Sep 13 07:07:19.438583 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 383/794] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Sep 13 07:07:19 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 07:07:19.505747 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f9713899-6ce3-412c-b43f-471498a15092 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:19.506356 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f9713899-6ce3-412c-b43f-471498a15092 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:19.512846 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f9713899-6ce3-412c-b43f-471498a15092 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:19.513331 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f9713899-6ce3-412c-b43f-471498a15092 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:19.513757 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f9713899-6ce3-412c-b43f-471498a15092 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:19.514504 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f9713899-6ce3-412c-b43f-471498a15092 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:19.514955 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f9713899-6ce3-412c-b43f-471498a15092 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:19.515357 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f9713899-6ce3-412c-b43f-471498a15092 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:19.574516 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f9713899-6ce3-412c-b43f-471498a15092 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:07:19.637915 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:19.747814 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f9713899-6ce3-412c-b43f-471498a15092 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 204 len: 0 microversion: 2.1 time: 0.245586 Sep 13 07:07:19.748552 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 412/795] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:07:19 2022] DELETE /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:07:19.756957 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-dacba1a4-3a77-490e-828e-f8cfee4633ef tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:19.758110 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-dacba1a4-3a77-490e-828e-f8cfee4633ef tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:19.769787 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dacba1a4-3a77-490e-828e-f8cfee4633ef tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:19.770574 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dacba1a4-3a77-490e-828e-f8cfee4633ef tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:19.771107 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dacba1a4-3a77-490e-828e-f8cfee4633ef tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:19.772821 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dacba1a4-3a77-490e-828e-f8cfee4633ef tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:19.778454 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dacba1a4-3a77-490e-828e-f8cfee4633ef tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:19.779017 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dacba1a4-3a77-490e-828e-f8cfee4633ef tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:19.820150 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-45ada3e2-6c76-4daa-922c-29b789bbedee req-b105b6de-c5fb-4aea-b0ac-7e0d8b7c6289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d695cc83-d3c5-44c9-af4a-2f0e67a96adf", "name": "network-vif-unplugged", "status": "completed", "tag": "a7477596-3b59-40f9-9676-9d56b3b3aba4"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:07:19.835245 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-45ada3e2-6c76-4daa-922c-29b789bbedee req-b105b6de-c5fb-4aea-b0ac-7e0d8b7c6289 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:19.836088 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-45ada3e2-6c76-4daa-922c-29b789bbedee req-b105b6de-c5fb-4aea-b0ac-7e0d8b7c6289 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:19.837086 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-45ada3e2-6c76-4daa-922c-29b789bbedee req-b105b6de-c5fb-4aea-b0ac-7e0d8b7c6289 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:19.851867 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.compute.server_external_events [req-45ada3e2-6c76-4daa-922c-29b789bbedee req-b105b6de-c5fb-4aea-b0ac-7e0d8b7c6289 service nova] Unable to find a host for instance d695cc83-d3c5-44c9-af4a-2f0e67a96adf. Dropping event network-vif-unplugged {{(pid=120696) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 13 07:07:19.853190 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-45ada3e2-6c76-4daa-922c-29b789bbedee req-b105b6de-c5fb-4aea-b0ac-7e0d8b7c6289 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037942 Sep 13 07:07:19.854002 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 413/796] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 13 07:07:20.021028 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-dacba1a4-3a77-490e-828e-f8cfee4633ef tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:20.030199 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-dacba1a4-3a77-490e-828e-f8cfee4633ef tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1681 microversion: 2.1 time: 0.277040 Sep 13 07:07:20.046803 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 384/797] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:19 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1681 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:20.165053 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ed2937a0-489c-41ce-9d85-7858f9f4a7b1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:20.165789 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ed2937a0-489c-41ce-9d85-7858f9f4a7b1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:20.172161 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ed2937a0-489c-41ce-9d85-7858f9f4a7b1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:20.172999 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ed2937a0-489c-41ce-9d85-7858f9f4a7b1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:20.173590 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ed2937a0-489c-41ce-9d85-7858f9f4a7b1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:20.174490 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ed2937a0-489c-41ce-9d85-7858f9f4a7b1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:20.175144 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ed2937a0-489c-41ce-9d85-7858f9f4a7b1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:20.175721 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ed2937a0-489c-41ce-9d85-7858f9f4a7b1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:20.195834 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-25fc0b8b-50d6-4c66-bbd2-f8c46cbe05ce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:20.196911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-25fc0b8b-50d6-4c66-bbd2-f8c46cbe05ce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:20.206918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-25fc0b8b-50d6-4c66-bbd2-f8c46cbe05ce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:20.207405 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-25fc0b8b-50d6-4c66-bbd2-f8c46cbe05ce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:20.210408 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-25fc0b8b-50d6-4c66-bbd2-f8c46cbe05ce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:20.211579 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-25fc0b8b-50d6-4c66-bbd2-f8c46cbe05ce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:20.212358 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-25fc0b8b-50d6-4c66-bbd2-f8c46cbe05ce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:20.214656 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-25fc0b8b-50d6-4c66-bbd2-f8c46cbe05ce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:20.385663 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ed2937a0-489c-41ce-9d85-7858f9f4a7b1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:20.397049 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ed2937a0-489c-41ce-9d85-7858f9f4a7b1 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1520 microversion: 2.1 time: 0.236022 Sep 13 07:07:20.400948 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 414/798] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:20 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:20.421888 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-25fc0b8b-50d6-4c66-bbd2-f8c46cbe05ce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:20.431401 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-25fc0b8b-50d6-4c66-bbd2-f8c46cbe05ce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:20.440179 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-25fc0b8b-50d6-4c66-bbd2-f8c46cbe05ce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:20.441690 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-25fc0b8b-50d6-4c66-bbd2-f8c46cbe05ce tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1731 microversion: 2.20 time: 0.249808 Sep 13 07:07:20.442510 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 385/799] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:20 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1731 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:07:21.059070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fa10d965-cc02-4385-8b10-892e1e8e7925 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:21.059766 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fa10d965-cc02-4385-8b10-892e1e8e7925 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:21.069092 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa10d965-cc02-4385-8b10-892e1e8e7925 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:21.069705 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa10d965-cc02-4385-8b10-892e1e8e7925 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:21.070458 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa10d965-cc02-4385-8b10-892e1e8e7925 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:21.071312 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa10d965-cc02-4385-8b10-892e1e8e7925 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:21.071757 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa10d965-cc02-4385-8b10-892e1e8e7925 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:21.072170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa10d965-cc02-4385-8b10-892e1e8e7925 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:21.218282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fa10d965-cc02-4385-8b10-892e1e8e7925 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:21.228531 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fa10d965-cc02-4385-8b10-892e1e8e7925 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1681 microversion: 2.1 time: 0.177062 Sep 13 07:07:21.229245 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 415/800] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:21 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:21.425301 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1a26c635-e906-4477-8556-ab6a9b04ef76 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:21.425885 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1a26c635-e906-4477-8556-ab6a9b04ef76 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:21.436087 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1a26c635-e906-4477-8556-ab6a9b04ef76 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:21.436783 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1a26c635-e906-4477-8556-ab6a9b04ef76 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:21.437348 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1a26c635-e906-4477-8556-ab6a9b04ef76 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:21.439367 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1a26c635-e906-4477-8556-ab6a9b04ef76 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:21.439942 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1a26c635-e906-4477-8556-ab6a9b04ef76 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:21.440559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1a26c635-e906-4477-8556-ab6a9b04ef76 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:21.469074 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f39dcc88-3332-4cde-aeed-d0bc081a5d14 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:21.470856 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f39dcc88-3332-4cde-aeed-d0bc081a5d14 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:21.480110 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f39dcc88-3332-4cde-aeed-d0bc081a5d14 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:21.480598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f39dcc88-3332-4cde-aeed-d0bc081a5d14 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:21.481026 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f39dcc88-3332-4cde-aeed-d0bc081a5d14 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:21.482350 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f39dcc88-3332-4cde-aeed-d0bc081a5d14 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:21.482972 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f39dcc88-3332-4cde-aeed-d0bc081a5d14 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:21.483541 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f39dcc88-3332-4cde-aeed-d0bc081a5d14 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:21.663138 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1a26c635-e906-4477-8556-ab6a9b04ef76 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:21.674073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1a26c635-e906-4477-8556-ab6a9b04ef76 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1520 microversion: 2.1 time: 0.252191 Sep 13 07:07:21.674991 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 386/801] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:21 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:21.683713 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f39dcc88-3332-4cde-aeed-d0bc081a5d14 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:21.693363 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f39dcc88-3332-4cde-aeed-d0bc081a5d14 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:21.695124 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f39dcc88-3332-4cde-aeed-d0bc081a5d14 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:21.697092 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f39dcc88-3332-4cde-aeed-d0bc081a5d14 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1731 microversion: 2.20 time: 0.232364 Sep 13 07:07:21.698376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 416/802] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:21 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1731 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:22.254921 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bb4ff6b0-407a-4440-973d-be36769f1271 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:22.255530 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bb4ff6b0-407a-4440-973d-be36769f1271 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:22.265435 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb4ff6b0-407a-4440-973d-be36769f1271 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:22.265912 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb4ff6b0-407a-4440-973d-be36769f1271 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:22.266359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb4ff6b0-407a-4440-973d-be36769f1271 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:22.267056 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb4ff6b0-407a-4440-973d-be36769f1271 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:22.269788 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb4ff6b0-407a-4440-973d-be36769f1271 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:22.270301 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb4ff6b0-407a-4440-973d-be36769f1271 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:22.454998 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bb4ff6b0-407a-4440-973d-be36769f1271 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:22.468593 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bb4ff6b0-407a-4440-973d-be36769f1271 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1681 microversion: 2.1 time: 0.219170 Sep 13 07:07:22.469563 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 387/803] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:22 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1681 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:22.699287 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1dc39de5-56e4-421f-89b8-577742a7edd8 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:22.700021 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1dc39de5-56e4-421f-89b8-577742a7edd8 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:22.707472 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1dc39de5-56e4-421f-89b8-577742a7edd8 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:22.708655 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1dc39de5-56e4-421f-89b8-577742a7edd8 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:22.709320 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1dc39de5-56e4-421f-89b8-577742a7edd8 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:22.710261 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1dc39de5-56e4-421f-89b8-577742a7edd8 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:22.710759 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1dc39de5-56e4-421f-89b8-577742a7edd8 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:22.711315 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1dc39de5-56e4-421f-89b8-577742a7edd8 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:22.724758 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-16f7fb3d-20e3-431f-8841-a3416d4b23a1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:22.725371 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-16f7fb3d-20e3-431f-8841-a3416d4b23a1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:22.731997 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-16f7fb3d-20e3-431f-8841-a3416d4b23a1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:22.732569 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-16f7fb3d-20e3-431f-8841-a3416d4b23a1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:22.733006 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-16f7fb3d-20e3-431f-8841-a3416d4b23a1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:22.733988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-16f7fb3d-20e3-431f-8841-a3416d4b23a1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:22.734620 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-16f7fb3d-20e3-431f-8841-a3416d4b23a1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:22.735210 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-16f7fb3d-20e3-431f-8841-a3416d4b23a1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:22.946976 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1dc39de5-56e4-421f-89b8-577742a7edd8 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:22.950321 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-16f7fb3d-20e3-431f-8841-a3416d4b23a1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:22.955227 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1dc39de5-56e4-421f-89b8-577742a7edd8 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1520 microversion: 2.1 time: 0.260260 Sep 13 07:07:22.955775 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 417/804] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:22 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:22.958933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-16f7fb3d-20e3-431f-8841-a3416d4b23a1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:22.960364 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-16f7fb3d-20e3-431f-8841-a3416d4b23a1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:22.961722 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-16f7fb3d-20e3-431f-8841-a3416d4b23a1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1731 microversion: 2.20 time: 0.240964 Sep 13 07:07:22.962309 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 388/805] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:22 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1731 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:07:23.496504 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f3ec6c3d-68a2-4673-b131-3ebbb256fc60 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:23.497109 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f3ec6c3d-68a2-4673-b131-3ebbb256fc60 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:23.503656 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f3ec6c3d-68a2-4673-b131-3ebbb256fc60 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:23.504135 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f3ec6c3d-68a2-4673-b131-3ebbb256fc60 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:23.504562 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f3ec6c3d-68a2-4673-b131-3ebbb256fc60 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:23.505248 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f3ec6c3d-68a2-4673-b131-3ebbb256fc60 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:23.505697 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f3ec6c3d-68a2-4673-b131-3ebbb256fc60 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:23.506149 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f3ec6c3d-68a2-4673-b131-3ebbb256fc60 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:23.650687 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f3ec6c3d-68a2-4673-b131-3ebbb256fc60 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:23.658722 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f3ec6c3d-68a2-4673-b131-3ebbb256fc60 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1681 microversion: 2.1 time: 0.166258 Sep 13 07:07:23.659329 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 418/806] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:23 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:23.986761 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-765fc58f-695a-4a75-8ba4-8bb750eae9f6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:23.988180 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-765fc58f-695a-4a75-8ba4-8bb750eae9f6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:23.997608 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-765fc58f-695a-4a75-8ba4-8bb750eae9f6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:23.998114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-765fc58f-695a-4a75-8ba4-8bb750eae9f6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:23.998537 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-765fc58f-695a-4a75-8ba4-8bb750eae9f6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:23.998749 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f56d3f0c-6df3-4b44-a225-c7940bf77133 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:23.999246 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-765fc58f-695a-4a75-8ba4-8bb750eae9f6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:23.999584 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f56d3f0c-6df3-4b44-a225-c7940bf77133 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:23.999685 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-765fc58f-695a-4a75-8ba4-8bb750eae9f6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:24.000061 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-765fc58f-695a-4a75-8ba4-8bb750eae9f6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:24.006795 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f56d3f0c-6df3-4b44-a225-c7940bf77133 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:24.007422 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f56d3f0c-6df3-4b44-a225-c7940bf77133 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:24.008328 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f56d3f0c-6df3-4b44-a225-c7940bf77133 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:24.009603 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f56d3f0c-6df3-4b44-a225-c7940bf77133 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:24.010164 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f56d3f0c-6df3-4b44-a225-c7940bf77133 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:24.010655 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f56d3f0c-6df3-4b44-a225-c7940bf77133 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:24.240577 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f56d3f0c-6df3-4b44-a225-c7940bf77133 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:24.257149 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f56d3f0c-6df3-4b44-a225-c7940bf77133 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:24.263076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f56d3f0c-6df3-4b44-a225-c7940bf77133 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:24.265070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f56d3f0c-6df3-4b44-a225-c7940bf77133 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1731 microversion: 2.20 time: 0.271119 Sep 13 07:07:24.276065 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 419/807] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:23 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1731 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:24.286059 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-84ac715f-eb49-47cf-9403-a88daeeb844b tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:24.289632 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-84ac715f-eb49-47cf-9403-a88daeeb844b tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:24.296756 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-84ac715f-eb49-47cf-9403-a88daeeb844b tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:24.297491 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-84ac715f-eb49-47cf-9403-a88daeeb844b tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:24.297954 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-84ac715f-eb49-47cf-9403-a88daeeb844b tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:24.299029 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-84ac715f-eb49-47cf-9403-a88daeeb844b tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:24.299487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-84ac715f-eb49-47cf-9403-a88daeeb844b tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:24.299900 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-84ac715f-eb49-47cf-9403-a88daeeb844b tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:24.347363 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-84ac715f-eb49-47cf-9403-a88daeeb844b tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:07:24.400209 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-765fc58f-695a-4a75-8ba4-8bb750eae9f6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:24.438649 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-765fc58f-695a-4a75-8ba4-8bb750eae9f6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1520 microversion: 2.1 time: 0.446737 Sep 13 07:07:24.438649 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 389/808] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:23 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1520 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:24.480711 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-84ac715f-eb49-47cf-9403-a88daeeb844b tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "DELETE /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 204 len: 0 microversion: 2.1 time: 0.203136 Sep 13 07:07:24.481707 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 420/809] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:07:24 2022] DELETE /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:07:24.491519 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b2b07d1b-2f71-458e-ad74-4e60d5957bac tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:24.492491 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b2b07d1b-2f71-458e-ad74-4e60d5957bac tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:24.499289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2b07d1b-2f71-458e-ad74-4e60d5957bac tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:24.500190 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2b07d1b-2f71-458e-ad74-4e60d5957bac tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:24.500928 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2b07d1b-2f71-458e-ad74-4e60d5957bac tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:24.501834 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2b07d1b-2f71-458e-ad74-4e60d5957bac tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:24.502521 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2b07d1b-2f71-458e-ad74-4e60d5957bac tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:24.503394 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2b07d1b-2f71-458e-ad74-4e60d5957bac tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:24.657475 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b2b07d1b-2f71-458e-ad74-4e60d5957bac tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:24.668655 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b2b07d1b-2f71-458e-ad74-4e60d5957bac tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1579 microversion: 2.1 time: 0.182349 Sep 13 07:07:24.669593 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 390/810] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:24 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1579 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:24.685058 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cf75e9a1-8ccd-4d7c-8654-a38f54485c43 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:24.685766 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cf75e9a1-8ccd-4d7c-8654-a38f54485c43 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:24.691964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cf75e9a1-8ccd-4d7c-8654-a38f54485c43 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:24.692533 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cf75e9a1-8ccd-4d7c-8654-a38f54485c43 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:24.693028 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cf75e9a1-8ccd-4d7c-8654-a38f54485c43 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:24.693800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cf75e9a1-8ccd-4d7c-8654-a38f54485c43 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:24.694288 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cf75e9a1-8ccd-4d7c-8654-a38f54485c43 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:24.694716 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cf75e9a1-8ccd-4d7c-8654-a38f54485c43 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:24.831401 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cf75e9a1-8ccd-4d7c-8654-a38f54485c43 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:24.840095 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cf75e9a1-8ccd-4d7c-8654-a38f54485c43 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1681 microversion: 2.1 time: 0.160055 Sep 13 07:07:24.840932 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 421/811] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:24 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:25.295062 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-756264f1-ba06-4d48-bda5-ce7d31e21c47 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:25.295930 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-756264f1-ba06-4d48-bda5-ce7d31e21c47 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:25.302953 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-756264f1-ba06-4d48-bda5-ce7d31e21c47 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:25.303445 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-756264f1-ba06-4d48-bda5-ce7d31e21c47 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:25.303881 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-756264f1-ba06-4d48-bda5-ce7d31e21c47 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:25.304714 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-756264f1-ba06-4d48-bda5-ce7d31e21c47 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:25.306309 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-756264f1-ba06-4d48-bda5-ce7d31e21c47 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:25.306745 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-756264f1-ba06-4d48-bda5-ce7d31e21c47 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:25.449093 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-756264f1-ba06-4d48-bda5-ce7d31e21c47 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:25.456585 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-37e42656-ac11-4723-9f5f-1d78a73e67e7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:25.457346 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-37e42656-ac11-4723-9f5f-1d78a73e67e7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:25.458643 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-756264f1-ba06-4d48-bda5-ce7d31e21c47 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:25.460293 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-756264f1-ba06-4d48-bda5-ce7d31e21c47 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:25.461276 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-756264f1-ba06-4d48-bda5-ce7d31e21c47 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1731 microversion: 2.20 time: 0.170284 Sep 13 07:07:25.461824 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 391/812] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:25 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:25.484334 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-37e42656-ac11-4723-9f5f-1d78a73e67e7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:25.484915 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-37e42656-ac11-4723-9f5f-1d78a73e67e7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:25.485430 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-37e42656-ac11-4723-9f5f-1d78a73e67e7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:25.486258 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-37e42656-ac11-4723-9f5f-1d78a73e67e7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:25.486822 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-37e42656-ac11-4723-9f5f-1d78a73e67e7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:25.487287 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-37e42656-ac11-4723-9f5f-1d78a73e67e7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:25.630285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-37e42656-ac11-4723-9f5f-1d78a73e67e7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:25.638817 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-37e42656-ac11-4723-9f5f-1d78a73e67e7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1520 microversion: 2.1 time: 0.187202 Sep 13 07:07:25.639583 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 422/813] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:25 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:07:25.693735 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0fdb6d58-4418-44d7-804d-792d3c03aede tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:25.694518 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0fdb6d58-4418-44d7-804d-792d3c03aede tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:25.702324 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0fdb6d58-4418-44d7-804d-792d3c03aede tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:25.702837 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0fdb6d58-4418-44d7-804d-792d3c03aede tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:25.703306 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0fdb6d58-4418-44d7-804d-792d3c03aede tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:25.703950 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0fdb6d58-4418-44d7-804d-792d3c03aede tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:25.704526 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0fdb6d58-4418-44d7-804d-792d3c03aede tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:25.704794 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0fdb6d58-4418-44d7-804d-792d3c03aede tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:25.848938 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0fdb6d58-4418-44d7-804d-792d3c03aede tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:25.857876 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0fdb6d58-4418-44d7-804d-792d3c03aede tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1579 microversion: 2.1 time: 0.168618 Sep 13 07:07:25.863810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7159c05c-23f1-4419-aa92-793c29405480 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:25.864424 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7159c05c-23f1-4419-aa92-793c29405480 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:25.865968 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 392/814] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:25 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1579 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:25.870806 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7159c05c-23f1-4419-aa92-793c29405480 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:25.871297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7159c05c-23f1-4419-aa92-793c29405480 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:25.871724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7159c05c-23f1-4419-aa92-793c29405480 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:25.872422 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7159c05c-23f1-4419-aa92-793c29405480 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:25.872868 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7159c05c-23f1-4419-aa92-793c29405480 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:25.873292 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7159c05c-23f1-4419-aa92-793c29405480 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:26.012265 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7159c05c-23f1-4419-aa92-793c29405480 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:26.020695 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7159c05c-23f1-4419-aa92-793c29405480 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1681 microversion: 2.1 time: 0.160735 Sep 13 07:07:26.021304 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 423/815] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:25 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:26.487243 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2f492f99-4646-439a-b781-fa1a8791cd95 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:26.487843 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2f492f99-4646-439a-b781-fa1a8791cd95 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:26.495470 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2f492f99-4646-439a-b781-fa1a8791cd95 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:26.496002 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2f492f99-4646-439a-b781-fa1a8791cd95 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:26.496382 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2f492f99-4646-439a-b781-fa1a8791cd95 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:26.497085 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2f492f99-4646-439a-b781-fa1a8791cd95 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:26.497533 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2f492f99-4646-439a-b781-fa1a8791cd95 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:26.497952 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2f492f99-4646-439a-b781-fa1a8791cd95 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:26.502433 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=97,nova_cell1:INSERT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:26.664098 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-71c4b1d1-5286-4da3-b0b2-7de8d4c82695 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:26.664869 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-71c4b1d1-5286-4da3-b0b2-7de8d4c82695 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:26.672799 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2f492f99-4646-439a-b781-fa1a8791cd95 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:26.682320 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-71c4b1d1-5286-4da3-b0b2-7de8d4c82695 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:26.682537 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2f492f99-4646-439a-b781-fa1a8791cd95 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:26.683062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-71c4b1d1-5286-4da3-b0b2-7de8d4c82695 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:26.683515 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-71c4b1d1-5286-4da3-b0b2-7de8d4c82695 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:26.684113 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2f492f99-4646-439a-b781-fa1a8791cd95 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:26.684248 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-71c4b1d1-5286-4da3-b0b2-7de8d4c82695 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:26.684691 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-71c4b1d1-5286-4da3-b0b2-7de8d4c82695 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:26.685106 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-71c4b1d1-5286-4da3-b0b2-7de8d4c82695 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:26.685521 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2f492f99-4646-439a-b781-fa1a8791cd95 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1731 microversion: 2.20 time: 0.202472 Sep 13 07:07:26.689578 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 393/816] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:26 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:26.831140 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-71c4b1d1-5286-4da3-b0b2-7de8d4c82695 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:26.839722 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-71c4b1d1-5286-4da3-b0b2-7de8d4c82695 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1520 microversion: 2.1 time: 0.180394 Sep 13 07:07:26.840274 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 424/817] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:26 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:07:26.881228 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1fad0247-2840-4318-a790-0da241eb19ca tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:26.881837 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1fad0247-2840-4318-a790-0da241eb19ca tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:26.889427 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1fad0247-2840-4318-a790-0da241eb19ca tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:26.889957 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1fad0247-2840-4318-a790-0da241eb19ca tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:26.890563 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1fad0247-2840-4318-a790-0da241eb19ca tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:26.892089 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1fad0247-2840-4318-a790-0da241eb19ca tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:26.892758 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1fad0247-2840-4318-a790-0da241eb19ca tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:26.893180 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1fad0247-2840-4318-a790-0da241eb19ca tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:27.038616 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1fad0247-2840-4318-a790-0da241eb19ca tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:27.044772 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2d480240-d3da-4320-b392-dc33a24ad2fc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:27.045541 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2d480240-d3da-4320-b392-dc33a24ad2fc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:27.050021 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1fad0247-2840-4318-a790-0da241eb19ca tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1579 microversion: 2.1 time: 0.172597 Sep 13 07:07:27.050638 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 394/818] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:26 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1579 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:27.051964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d480240-d3da-4320-b392-dc33a24ad2fc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:27.052444 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d480240-d3da-4320-b392-dc33a24ad2fc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:27.052869 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d480240-d3da-4320-b392-dc33a24ad2fc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:27.053562 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d480240-d3da-4320-b392-dc33a24ad2fc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:27.054001 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d480240-d3da-4320-b392-dc33a24ad2fc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:27.054451 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d480240-d3da-4320-b392-dc33a24ad2fc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:27.218442 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2d480240-d3da-4320-b392-dc33a24ad2fc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:27.227952 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2d480240-d3da-4320-b392-dc33a24ad2fc tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1681 microversion: 2.1 time: 0.187207 Sep 13 07:07:27.228924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 425/819] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:27 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:07:27.713828 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c99c3086-8e23-439f-b3b6-a1e21de95818 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:27.714511 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c99c3086-8e23-439f-b3b6-a1e21de95818 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:27.723856 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c99c3086-8e23-439f-b3b6-a1e21de95818 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:27.724523 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c99c3086-8e23-439f-b3b6-a1e21de95818 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:27.725062 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c99c3086-8e23-439f-b3b6-a1e21de95818 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:27.726001 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c99c3086-8e23-439f-b3b6-a1e21de95818 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:27.726721 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c99c3086-8e23-439f-b3b6-a1e21de95818 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:27.727142 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c99c3086-8e23-439f-b3b6-a1e21de95818 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:27.864234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fcc82a6a-3e5a-49a6-b41d-c7e7a58d3a4e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:27.864881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fcc82a6a-3e5a-49a6-b41d-c7e7a58d3a4e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:27.867420 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c99c3086-8e23-439f-b3b6-a1e21de95818 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:27.871777 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fcc82a6a-3e5a-49a6-b41d-c7e7a58d3a4e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:27.872167 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fcc82a6a-3e5a-49a6-b41d-c7e7a58d3a4e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:27.872625 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fcc82a6a-3e5a-49a6-b41d-c7e7a58d3a4e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:27.873313 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fcc82a6a-3e5a-49a6-b41d-c7e7a58d3a4e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:27.873852 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fcc82a6a-3e5a-49a6-b41d-c7e7a58d3a4e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:27.874297 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fcc82a6a-3e5a-49a6-b41d-c7e7a58d3a4e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:27.876570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c99c3086-8e23-439f-b3b6-a1e21de95818 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:27.878007 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c99c3086-8e23-439f-b3b6-a1e21de95818 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:27.879214 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c99c3086-8e23-439f-b3b6-a1e21de95818 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1731 microversion: 2.20 time: 0.171414 Sep 13 07:07:27.879780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 395/820] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:27 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:28.016749 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fcc82a6a-3e5a-49a6-b41d-c7e7a58d3a4e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:28.027046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fcc82a6a-3e5a-49a6-b41d-c7e7a58d3a4e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1520 microversion: 2.1 time: 0.166743 Sep 13 07:07:28.027617 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 426/821] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:27 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:28.076790 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bfe1b2d0-3403-495e-9638-eae394c2414a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:28.077646 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bfe1b2d0-3403-495e-9638-eae394c2414a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:28.086527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bfe1b2d0-3403-495e-9638-eae394c2414a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:28.087034 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bfe1b2d0-3403-495e-9638-eae394c2414a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:28.087468 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bfe1b2d0-3403-495e-9638-eae394c2414a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:28.088166 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bfe1b2d0-3403-495e-9638-eae394c2414a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:28.088613 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bfe1b2d0-3403-495e-9638-eae394c2414a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:28.089034 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bfe1b2d0-3403-495e-9638-eae394c2414a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:28.238847 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bfe1b2d0-3403-495e-9638-eae394c2414a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:28.248264 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bfe1b2d0-3403-495e-9638-eae394c2414a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1579 microversion: 2.1 time: 0.177575 Sep 13 07:07:28.248849 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 396/822] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:28 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1579 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:28.252111 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7fe57ba7-05ab-4c22-81ff-3a98cccb9a4c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:28.252862 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7fe57ba7-05ab-4c22-81ff-3a98cccb9a4c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:28.259879 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7fe57ba7-05ab-4c22-81ff-3a98cccb9a4c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:28.260443 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7fe57ba7-05ab-4c22-81ff-3a98cccb9a4c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:28.260942 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7fe57ba7-05ab-4c22-81ff-3a98cccb9a4c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:28.261705 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7fe57ba7-05ab-4c22-81ff-3a98cccb9a4c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:28.262271 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7fe57ba7-05ab-4c22-81ff-3a98cccb9a4c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:28.262754 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7fe57ba7-05ab-4c22-81ff-3a98cccb9a4c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:28.401697 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7fe57ba7-05ab-4c22-81ff-3a98cccb9a4c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:28.404115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:28.410773 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7fe57ba7-05ab-4c22-81ff-3a98cccb9a4c tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1681 microversion: 2.1 time: 0.163027 Sep 13 07:07:28.411679 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 427/823] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:28 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:28.910136 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-82f294e1-f93c-4857-a4a9-c9a4dc496ba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:28.910884 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-82f294e1-f93c-4857-a4a9-c9a4dc496ba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:28.921002 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82f294e1-f93c-4857-a4a9-c9a4dc496ba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:28.921682 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82f294e1-f93c-4857-a4a9-c9a4dc496ba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:28.922352 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82f294e1-f93c-4857-a4a9-c9a4dc496ba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:28.923396 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82f294e1-f93c-4857-a4a9-c9a4dc496ba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:28.924065 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82f294e1-f93c-4857-a4a9-c9a4dc496ba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:28.924692 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82f294e1-f93c-4857-a4a9-c9a4dc496ba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:29.050827 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-aa0a1f65-fe8c-40a2-8e49-28bbc8089d50 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:29.051557 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-aa0a1f65-fe8c-40a2-8e49-28bbc8089d50 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:29.059169 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aa0a1f65-fe8c-40a2-8e49-28bbc8089d50 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:29.059727 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aa0a1f65-fe8c-40a2-8e49-28bbc8089d50 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:29.060221 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aa0a1f65-fe8c-40a2-8e49-28bbc8089d50 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:29.060911 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aa0a1f65-fe8c-40a2-8e49-28bbc8089d50 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:29.061361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aa0a1f65-fe8c-40a2-8e49-28bbc8089d50 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:29.061775 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aa0a1f65-fe8c-40a2-8e49-28bbc8089d50 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:29.073104 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-82f294e1-f93c-4857-a4a9-c9a4dc496ba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:29.081450 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-82f294e1-f93c-4857-a4a9-c9a4dc496ba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:29.082913 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-82f294e1-f93c-4857-a4a9-c9a4dc496ba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:29.084083 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-82f294e1-f93c-4857-a4a9-c9a4dc496ba4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1731 microversion: 2.20 time: 0.180283 Sep 13 07:07:29.084641 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 397/824] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:28 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:29.204861 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-aa0a1f65-fe8c-40a2-8e49-28bbc8089d50 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:29.216603 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-aa0a1f65-fe8c-40a2-8e49-28bbc8089d50 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1520 microversion: 2.1 time: 0.170281 Sep 13 07:07:29.217405 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 428/825] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:29 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:29.272416 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e8bc909e-06d1-40f3-a2de-82d54e04ca97 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:29.273017 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e8bc909e-06d1-40f3-a2de-82d54e04ca97 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:29.280840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e8bc909e-06d1-40f3-a2de-82d54e04ca97 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:29.281324 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e8bc909e-06d1-40f3-a2de-82d54e04ca97 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:29.281754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e8bc909e-06d1-40f3-a2de-82d54e04ca97 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:29.282483 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e8bc909e-06d1-40f3-a2de-82d54e04ca97 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:29.282927 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e8bc909e-06d1-40f3-a2de-82d54e04ca97 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:29.283340 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e8bc909e-06d1-40f3-a2de-82d54e04ca97 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:29.419957 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e8bc909e-06d1-40f3-a2de-82d54e04ca97 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:29.431708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e8bc909e-06d1-40f3-a2de-82d54e04ca97 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1579 microversion: 2.1 time: 0.163158 Sep 13 07:07:29.432243 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 398/826] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:29 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1579 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:29.435805 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ea9d859f-b444-4eb9-b63d-04d04115ff5f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:29.436422 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ea9d859f-b444-4eb9-b63d-04d04115ff5f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:29.443046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea9d859f-b444-4eb9-b63d-04d04115ff5f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:29.443539 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea9d859f-b444-4eb9-b63d-04d04115ff5f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:29.444534 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea9d859f-b444-4eb9-b63d-04d04115ff5f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:29.445324 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea9d859f-b444-4eb9-b63d-04d04115ff5f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:29.445775 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea9d859f-b444-4eb9-b63d-04d04115ff5f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:29.446346 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea9d859f-b444-4eb9-b63d-04d04115ff5f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:29.581746 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ea9d859f-b444-4eb9-b63d-04d04115ff5f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:29.590200 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ea9d859f-b444-4eb9-b63d-04d04115ff5f tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1681 microversion: 2.1 time: 0.158437 Sep 13 07:07:29.590765 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 429/827] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:29 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:30.109241 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d949c7c6-ffa9-4112-98b9-e785922bcaca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:30.109828 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d949c7c6-ffa9-4112-98b9-e785922bcaca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:30.112077 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:30.117582 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d949c7c6-ffa9-4112-98b9-e785922bcaca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:30.118241 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d949c7c6-ffa9-4112-98b9-e785922bcaca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:30.118674 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d949c7c6-ffa9-4112-98b9-e785922bcaca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:30.119356 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d949c7c6-ffa9-4112-98b9-e785922bcaca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:30.119804 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d949c7c6-ffa9-4112-98b9-e785922bcaca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:30.120213 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d949c7c6-ffa9-4112-98b9-e785922bcaca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:30.240434 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ca2c40f5-d32d-4578-b89e-c0fb4d3a01c4 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:30.241067 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ca2c40f5-d32d-4578-b89e-c0fb4d3a01c4 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:30.247751 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ca2c40f5-d32d-4578-b89e-c0fb4d3a01c4 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:30.248218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ca2c40f5-d32d-4578-b89e-c0fb4d3a01c4 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:30.248645 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ca2c40f5-d32d-4578-b89e-c0fb4d3a01c4 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:30.249339 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ca2c40f5-d32d-4578-b89e-c0fb4d3a01c4 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:30.249787 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ca2c40f5-d32d-4578-b89e-c0fb4d3a01c4 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:30.250230 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ca2c40f5-d32d-4578-b89e-c0fb4d3a01c4 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:30.261478 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d949c7c6-ffa9-4112-98b9-e785922bcaca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:30.270308 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d949c7c6-ffa9-4112-98b9-e785922bcaca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:30.271768 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d949c7c6-ffa9-4112-98b9-e785922bcaca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:30.272944 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d949c7c6-ffa9-4112-98b9-e785922bcaca tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1731 microversion: 2.20 time: 0.167778 Sep 13 07:07:30.273837 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 399/828] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:30 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:30.387847 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ca2c40f5-d32d-4578-b89e-c0fb4d3a01c4 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:30.395966 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ca2c40f5-d32d-4578-b89e-c0fb4d3a01c4 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1520 microversion: 2.1 time: 0.159515 Sep 13 07:07:30.396565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 430/829] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:30 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:30.455146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4ddf937b-dcba-440e-bee3-baf9fdcac73f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:30.455787 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4ddf937b-dcba-440e-bee3-baf9fdcac73f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:30.462232 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ddf937b-dcba-440e-bee3-baf9fdcac73f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:30.462719 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ddf937b-dcba-440e-bee3-baf9fdcac73f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:30.463156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ddf937b-dcba-440e-bee3-baf9fdcac73f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:30.463851 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ddf937b-dcba-440e-bee3-baf9fdcac73f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:30.464306 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ddf937b-dcba-440e-bee3-baf9fdcac73f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:30.464726 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ddf937b-dcba-440e-bee3-baf9fdcac73f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:30.603699 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4ddf937b-dcba-440e-bee3-baf9fdcac73f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:30.612835 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4ddf937b-dcba-440e-bee3-baf9fdcac73f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1579 microversion: 2.1 time: 0.161411 Sep 13 07:07:30.613308 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-12444776-2640-4543-b3a8-b789b80ca045 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:30.613801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 400/830] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:30 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:30.613961 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-12444776-2640-4543-b3a8-b789b80ca045 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:30.620951 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12444776-2640-4543-b3a8-b789b80ca045 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:30.621432 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12444776-2640-4543-b3a8-b789b80ca045 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:30.621845 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12444776-2640-4543-b3a8-b789b80ca045 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:30.622610 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12444776-2640-4543-b3a8-b789b80ca045 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:30.623031 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12444776-2640-4543-b3a8-b789b80ca045 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:30.623471 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12444776-2640-4543-b3a8-b789b80ca045 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:30.757206 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-12444776-2640-4543-b3a8-b789b80ca045 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:30.766025 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-12444776-2640-4543-b3a8-b789b80ca045 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1681 microversion: 2.1 time: 0.156799 Sep 13 07:07:30.766664 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 431/831] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:30 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:07:31.298954 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9a1751ad-180f-4792-9f3b-ea88f7e61404 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:31.299590 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9a1751ad-180f-4792-9f3b-ea88f7e61404 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:31.307097 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a1751ad-180f-4792-9f3b-ea88f7e61404 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:31.307574 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a1751ad-180f-4792-9f3b-ea88f7e61404 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:31.308167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a1751ad-180f-4792-9f3b-ea88f7e61404 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:31.308859 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a1751ad-180f-4792-9f3b-ea88f7e61404 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:31.309308 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a1751ad-180f-4792-9f3b-ea88f7e61404 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:31.309727 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a1751ad-180f-4792-9f3b-ea88f7e61404 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:31.419706 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5d6df084-088e-4959-ab81-932e38938be2 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:31.420386 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5d6df084-088e-4959-ab81-932e38938be2 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:31.426584 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d6df084-088e-4959-ab81-932e38938be2 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:31.427147 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d6df084-088e-4959-ab81-932e38938be2 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:31.427641 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d6df084-088e-4959-ab81-932e38938be2 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:31.428395 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d6df084-088e-4959-ab81-932e38938be2 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:31.429163 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d6df084-088e-4959-ab81-932e38938be2 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:31.430120 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d6df084-088e-4959-ab81-932e38938be2 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:31.445981 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9a1751ad-180f-4792-9f3b-ea88f7e61404 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:31.454311 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9a1751ad-180f-4792-9f3b-ea88f7e61404 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:31.455762 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9a1751ad-180f-4792-9f3b-ea88f7e61404 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:31.456957 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9a1751ad-180f-4792-9f3b-ea88f7e61404 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1731 microversion: 2.20 time: 0.162030 Sep 13 07:07:31.457495 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 401/832] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:31 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:31.563915 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5d6df084-088e-4959-ab81-932e38938be2 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:31.572127 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5d6df084-088e-4959-ab81-932e38938be2 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1520 microversion: 2.1 time: 0.156337 Sep 13 07:07:31.572704 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 432/833] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:31 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:07:31.637367 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4faa06b1-c0d7-4bfd-97e1-0f961c79b510 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:31.638114 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4faa06b1-c0d7-4bfd-97e1-0f961c79b510 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:31.644530 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4faa06b1-c0d7-4bfd-97e1-0f961c79b510 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:31.645014 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4faa06b1-c0d7-4bfd-97e1-0f961c79b510 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:31.645443 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4faa06b1-c0d7-4bfd-97e1-0f961c79b510 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:31.646172 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4faa06b1-c0d7-4bfd-97e1-0f961c79b510 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:31.646630 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4faa06b1-c0d7-4bfd-97e1-0f961c79b510 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:31.647050 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4faa06b1-c0d7-4bfd-97e1-0f961c79b510 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:31.785490 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4faa06b1-c0d7-4bfd-97e1-0f961c79b510 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:31.789453 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3841ce34-a6a4-4211-b40d-2a0ecc140b72 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:31.790102 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3841ce34-a6a4-4211-b40d-2a0ecc140b72 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:31.793443 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:31.793697 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4faa06b1-c0d7-4bfd-97e1-0f961c79b510 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1579 microversion: 2.1 time: 0.160890 Sep 13 07:07:31.794348 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 402/834] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:31 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:31.797079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3841ce34-a6a4-4211-b40d-2a0ecc140b72 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:31.797568 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3841ce34-a6a4-4211-b40d-2a0ecc140b72 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:31.797992 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3841ce34-a6a4-4211-b40d-2a0ecc140b72 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:31.798761 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3841ce34-a6a4-4211-b40d-2a0ecc140b72 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:31.799212 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3841ce34-a6a4-4211-b40d-2a0ecc140b72 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:31.799632 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3841ce34-a6a4-4211-b40d-2a0ecc140b72 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:31.941404 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3841ce34-a6a4-4211-b40d-2a0ecc140b72 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:31.950871 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3841ce34-a6a4-4211-b40d-2a0ecc140b72 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1681 microversion: 2.1 time: 0.164924 Sep 13 07:07:31.951728 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 433/835] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:31 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:07:32.482917 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bc8bae78-ba8b-46c5-b894-1f84db2e8058 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:32.483519 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bc8bae78-ba8b-46c5-b894-1f84db2e8058 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:32.490799 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc8bae78-ba8b-46c5-b894-1f84db2e8058 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:32.491408 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc8bae78-ba8b-46c5-b894-1f84db2e8058 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:32.492158 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc8bae78-ba8b-46c5-b894-1f84db2e8058 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:32.493625 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc8bae78-ba8b-46c5-b894-1f84db2e8058 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:32.494170 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc8bae78-ba8b-46c5-b894-1f84db2e8058 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:32.494656 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc8bae78-ba8b-46c5-b894-1f84db2e8058 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:32.598726 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fa98930b-442e-46c1-982e-2162e095b303 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:32.600726 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fa98930b-442e-46c1-982e-2162e095b303 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:32.610935 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa98930b-442e-46c1-982e-2162e095b303 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:32.611763 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa98930b-442e-46c1-982e-2162e095b303 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:32.612200 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa98930b-442e-46c1-982e-2162e095b303 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:32.612924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa98930b-442e-46c1-982e-2162e095b303 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:32.613369 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa98930b-442e-46c1-982e-2162e095b303 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:32.614610 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa98930b-442e-46c1-982e-2162e095b303 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:32.847988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bc8bae78-ba8b-46c5-b894-1f84db2e8058 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:32.857784 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bc8bae78-ba8b-46c5-b894-1f84db2e8058 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:32.888823 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bc8bae78-ba8b-46c5-b894-1f84db2e8058 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:32.919823 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bc8bae78-ba8b-46c5-b894-1f84db2e8058 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1731 microversion: 2.20 time: 0.438290 Sep 13 07:07:32.963158 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fa98930b-442e-46c1-982e-2162e095b303 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:32.963755 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 403/836] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:32 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1731 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:32.963755 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-66dd8bcd-c94f-4c57-90d0-962b15d099bd tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:32.963755 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-66dd8bcd-c94f-4c57-90d0-962b15d099bd tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:32.963755 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-66dd8bcd-c94f-4c57-90d0-962b15d099bd tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:32.965596 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-66dd8bcd-c94f-4c57-90d0-962b15d099bd tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:32.965596 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-66dd8bcd-c94f-4c57-90d0-962b15d099bd tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:32.965596 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-66dd8bcd-c94f-4c57-90d0-962b15d099bd tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:32.965596 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-66dd8bcd-c94f-4c57-90d0-962b15d099bd tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:32.980674 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-66dd8bcd-c94f-4c57-90d0-962b15d099bd tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:32.980858 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fa98930b-442e-46c1-982e-2162e095b303 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1576 microversion: 2.1 time: 0.363743 Sep 13 07:07:32.980858 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 434/837] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:32 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1576 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:32.983794 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ea61648c-105a-48a7-95da-ccf8d156206a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:32.984748 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ea61648c-105a-48a7-95da-ccf8d156206a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:33.001949 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea61648c-105a-48a7-95da-ccf8d156206a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:33.003036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea61648c-105a-48a7-95da-ccf8d156206a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:33.003550 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea61648c-105a-48a7-95da-ccf8d156206a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:33.004353 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea61648c-105a-48a7-95da-ccf8d156206a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:33.004911 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea61648c-105a-48a7-95da-ccf8d156206a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:33.005585 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ea61648c-105a-48a7-95da-ccf8d156206a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:33.629447 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ea61648c-105a-48a7-95da-ccf8d156206a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0fd7347cad41bc80f427f872cf78fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc05c1c9d40b2bb0defc9dd157d6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:33.641552 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ea61648c-105a-48a7-95da-ccf8d156206a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 200 len: 1613 microversion: 2.1 time: 0.666716 Sep 13 07:07:33.642989 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 435/838] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:32 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 1613 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:33.645027 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-66dd8bcd-c94f-4c57-90d0-962b15d099bd tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:33.649006 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-96055e45-ae67-49ca-9a2b-6f912e12f9fb req-59f50de9-20f9-45fc-b8f8-3c2a9771b57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e5c5ee-a0fa-47a6-9040-6f84ec08df56", "name": "network-vif-deleted", "tag": "11a7948c-3f2b-4a5b-92c7-f59435f113d3"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:07:33.666982 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-66dd8bcd-c94f-4c57-90d0-962b15d099bd tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1579 microversion: 2.1 time: 0.745452 Sep 13 07:07:33.667771 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 404/839] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:32 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1579 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:33.671655 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-96055e45-ae67-49ca-9a2b-6f912e12f9fb req-59f50de9-20f9-45fc-b8f8-3c2a9771b57d service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:33.672141 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-96055e45-ae67-49ca-9a2b-6f912e12f9fb req-59f50de9-20f9-45fc-b8f8-3c2a9771b57d service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:33.672569 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-96055e45-ae67-49ca-9a2b-6f912e12f9fb req-59f50de9-20f9-45fc-b8f8-3c2a9771b57d service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:33.687583 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-96055e45-ae67-49ca-9a2b-6f912e12f9fb req-59f50de9-20f9-45fc-b8f8-3c2a9771b57d service nova] Creating event network-vif-deleted:11a7948c-3f2b-4a5b-92c7-f59435f113d3 for instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 on hv-cinder-85694 Sep 13 07:07:33.692595 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-96055e45-ae67-49ca-9a2b-6f912e12f9fb req-59f50de9-20f9-45fc-b8f8-3c2a9771b57d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047587 Sep 13 07:07:33.693184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 436/840] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:07:33.989271 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f5d2db9d-ec31-4ac2-9259-be912b10e2b5 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:33.990262 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f5d2db9d-ec31-4ac2-9259-be912b10e2b5 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:33.996779 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5d2db9d-ec31-4ac2-9259-be912b10e2b5 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:34.005556 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-de0e6673-0dfc-47e4-a65d-8fcc9c02a1ac tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:34.006983 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-de0e6673-0dfc-47e4-a65d-8fcc9c02a1ac tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:34.016849 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5d2db9d-ec31-4ac2-9259-be912b10e2b5 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:34.019674 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5d2db9d-ec31-4ac2-9259-be912b10e2b5 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:34.020860 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5d2db9d-ec31-4ac2-9259-be912b10e2b5 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:34.023012 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-de0e6673-0dfc-47e4-a65d-8fcc9c02a1ac tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:34.023706 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5d2db9d-ec31-4ac2-9259-be912b10e2b5 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:34.024238 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5d2db9d-ec31-4ac2-9259-be912b10e2b5 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:34.027915 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-de0e6673-0dfc-47e4-a65d-8fcc9c02a1ac tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:34.028541 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-de0e6673-0dfc-47e4-a65d-8fcc9c02a1ac tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:34.029354 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-de0e6673-0dfc-47e4-a65d-8fcc9c02a1ac tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:34.031467 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-de0e6673-0dfc-47e4-a65d-8fcc9c02a1ac tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:34.032142 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-de0e6673-0dfc-47e4-a65d-8fcc9c02a1ac tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:34.410765 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-de0e6673-0dfc-47e4-a65d-8fcc9c02a1ac tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:34.419630 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-de0e6673-0dfc-47e4-a65d-8fcc9c02a1ac tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:34.422978 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-de0e6673-0dfc-47e4-a65d-8fcc9c02a1ac tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:34.424214 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-de0e6673-0dfc-47e4-a65d-8fcc9c02a1ac tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1731 microversion: 2.20 time: 0.423589 Sep 13 07:07:34.424819 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 437/841] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:33 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1731 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:34.492408 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f5d2db9d-ec31-4ac2-9259-be912b10e2b5 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:34.501071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f5d2db9d-ec31-4ac2-9259-be912b10e2b5 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1576 microversion: 2.1 time: 0.520291 Sep 13 07:07:34.501882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 405/842] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:33 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1576 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:34.536334 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-52f63b19-c76f-4f7f-b947-85f132f83490 req-0370526b-61c0-4ea9-83c7-32e00faf413b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df5f6f23-54e8-43b0-a5a3-6e336b2a3582", "name": "network-vif-deleted", "tag": "a75edda5-2638-4320-afc1-42f9bdf0ed95"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:07:34.548379 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-52f63b19-c76f-4f7f-b947-85f132f83490 req-0370526b-61c0-4ea9-83c7-32e00faf413b service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:34.550172 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-52f63b19-c76f-4f7f-b947-85f132f83490 req-0370526b-61c0-4ea9-83c7-32e00faf413b service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:34.551675 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-52f63b19-c76f-4f7f-b947-85f132f83490 req-0370526b-61c0-4ea9-83c7-32e00faf413b service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:34.567470 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-52f63b19-c76f-4f7f-b947-85f132f83490 req-0370526b-61c0-4ea9-83c7-32e00faf413b service nova] Creating event network-vif-deleted:a75edda5-2638-4320-afc1-42f9bdf0ed95 for instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 on hv-cinder-85694 Sep 13 07:07:34.572616 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-52f63b19-c76f-4f7f-b947-85f132f83490 req-0370526b-61c0-4ea9-83c7-32e00faf413b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139636 Sep 13 07:07:34.573523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 438/843] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:07:34.665390 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4e63a6fb-f889-452c-be78-21cb4d99a8c3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:34.666401 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4e63a6fb-f889-452c-be78-21cb4d99a8c3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:34.672918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4e63a6fb-f889-452c-be78-21cb4d99a8c3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:34.673578 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4e63a6fb-f889-452c-be78-21cb4d99a8c3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:34.674252 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4e63a6fb-f889-452c-be78-21cb4d99a8c3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:34.675268 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4e63a6fb-f889-452c-be78-21cb4d99a8c3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:34.675922 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4e63a6fb-f889-452c-be78-21cb4d99a8c3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:34.676434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4e63a6fb-f889-452c-be78-21cb4d99a8c3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:34.694684 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-4e63a6fb-f889-452c-be78-21cb4d99a8c3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] HTTP exception thrown: Instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 could not be found. Sep 13 07:07:34.695738 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6d4ca142-4824-4290-9ec0-10ce671a6a87 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:34.696659 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6d4ca142-4824-4290-9ec0-10ce671a6a87 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:34.697667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4e63a6fb-f889-452c-be78-21cb4d99a8c3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Request method failure captured: Sep 13 07:07:34.697667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 HTTP/1.1 Sep 13 07:07:34.697667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:07:34.697667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:07:34.697667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:07:34.697667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:07:34.697667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:07:34.697667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:07:34.697667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:07:34.697667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:07:34.697667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICqyV8ZDoWvOKN7yB2xTUSeGEw-19LbL5z3b7FCDIrTHuyvYi1pO573AgmLpQMkZe3-u2HyPkAvEThrpkgPF3Y3DpDsAGrmh9FoN2kYrWow6jJnFAoIJGNoEoe53GgBmZUC7q0mN4-e6vnmtsq8cJkNCfkZrjfSjeL4PS70F44wGPd0 Sep 13 07:07:34.697667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:07:34.697667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:07:34.697667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:07:34.697667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:07:34.697667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:07:34.697667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:07:34.697667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:07:34.697667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:34.697667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:07:34.697667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:07:34.699433 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8c7dc05c1c9d40b2bb0defc9dd157d6e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:07:34.699433 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:34.699433 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:07:34.699433 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:34.699433 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:07:34.699433 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:07:34.699433 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:07:34.699433 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: 5a0fd7347cad41bc80f427f872cf78fa Sep 13 07:07:34.699433 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:07:34.699433 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:07:34.699433 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 could not be found. Sep 13 07:07:34.699433 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': 'e0e5c5ee-a0fa-47a6-9040-6f84ec08df56'} Sep 13 07:07:34.700451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:07:34.700451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:34.700451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:07:34.700451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:07:34.700451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:07:34.700451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:07:34.700451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:07:34.700451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:07:34.700451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:07:34.700451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:07:34.700451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 could not be found. Sep 13 07:07:34.700451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:34.700451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:07:34.700451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:34.700451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:34.700451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:07:34.700451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:07:34.700451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:07:34.700451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:07:34.700451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:07:34.702051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:07:34.702051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:07:34.702051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:07:34.702051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:07:34.702051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:07:34.702051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:07:34.702051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:07:34.702051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 could not be found. Sep 13 07:07:34.702051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:34.702051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:07:34.702051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:34.702051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:34.702051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:07:34.702051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:07:34.702051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:07:34.702051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:07:34.702051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 could not be found. Sep 13 07:07:34.702051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:34.703635 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4e63a6fb-f889-452c-be78-21cb4d99a8c3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Returning 404 to user: Instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:07:34.703743 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4e63a6fb-f889-452c-be78-21cb4d99a8c3 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 404 len: 111 microversion: 2.1 time: 0.041458 Sep 13 07:07:34.708002 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 406/844] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:34 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:07:34.713347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6d4ca142-4824-4290-9ec0-10ce671a6a87 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:34.713654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-396a65cd-a0db-46a6-aa03-3ad5a2788588 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '.version_select at 0x7f4c195743a0>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:34.716248 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6d4ca142-4824-4290-9ec0-10ce671a6a87 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:34.717437 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6d4ca142-4824-4290-9ec0-10ce671a6a87 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:34.718472 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6d4ca142-4824-4290-9ec0-10ce671a6a87 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:34.719140 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6d4ca142-4824-4290-9ec0-10ce671a6a87 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:34.720404 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6d4ca142-4824-4290-9ec0-10ce671a6a87 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:34.744524 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-396a65cd-a0db-46a6-aa03-3ad5a2788588 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-242755384" status: 202 len: 0 microversion: 2.1 time: 0.034647 Sep 13 07:07:34.747638 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 407/845] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Sep 13 07:07:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-242755384 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:07:34.815118 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6d4ca142-4824-4290-9ec0-10ce671a6a87 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:34.824813 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6d4ca142-4824-4290-9ec0-10ce671a6a87 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 200 len: 1225 microversion: 2.1 time: 0.136287 Sep 13 07:07:34.825743 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 439/846] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:34 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 1225 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:35.450425 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5c3b6c63-e3a9-48d7-9817-5a6a562d8734 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:35.451248 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5c3b6c63-e3a9-48d7-9817-5a6a562d8734 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:35.461374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c3b6c63-e3a9-48d7-9817-5a6a562d8734 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:35.462202 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c3b6c63-e3a9-48d7-9817-5a6a562d8734 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:35.462641 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c3b6c63-e3a9-48d7-9817-5a6a562d8734 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:35.463520 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c3b6c63-e3a9-48d7-9817-5a6a562d8734 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:35.463976 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c3b6c63-e3a9-48d7-9817-5a6a562d8734 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:35.464396 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c3b6c63-e3a9-48d7-9817-5a6a562d8734 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:35.525697 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-672c2998-dace-4532-9bc7-f873369c3582 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:35.526399 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-672c2998-dace-4532-9bc7-f873369c3582 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:35.536132 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-672c2998-dace-4532-9bc7-f873369c3582 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:35.536623 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-672c2998-dace-4532-9bc7-f873369c3582 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:35.537060 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-672c2998-dace-4532-9bc7-f873369c3582 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:35.537765 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-672c2998-dace-4532-9bc7-f873369c3582 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:35.538248 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-672c2998-dace-4532-9bc7-f873369c3582 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:35.538683 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-672c2998-dace-4532-9bc7-f873369c3582 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:35.654807 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5c3b6c63-e3a9-48d7-9817-5a6a562d8734 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:35.663520 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5c3b6c63-e3a9-48d7-9817-5a6a562d8734 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:35.665478 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5c3b6c63-e3a9-48d7-9817-5a6a562d8734 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:35.667371 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5c3b6c63-e3a9-48d7-9817-5a6a562d8734 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1731 microversion: 2.20 time: 0.221580 Sep 13 07:07:35.682285 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 408/847] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:35 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1731 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:35.703547 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-672c2998-dace-4532-9bc7-f873369c3582 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:35.711405 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-672c2998-dace-4532-9bc7-f873369c3582 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1576 microversion: 2.1 time: 0.190251 Sep 13 07:07:35.711949 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 440/848] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:35 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:07:35.849854 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ecc77214-04df-4270-829c-a7d5cf1c01b7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:35.850785 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ecc77214-04df-4270-829c-a7d5cf1c01b7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:35.857980 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ecc77214-04df-4270-829c-a7d5cf1c01b7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:35.858512 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ecc77214-04df-4270-829c-a7d5cf1c01b7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:35.859068 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ecc77214-04df-4270-829c-a7d5cf1c01b7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:35.859750 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ecc77214-04df-4270-829c-a7d5cf1c01b7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:35.860203 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ecc77214-04df-4270-829c-a7d5cf1c01b7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:35.860671 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ecc77214-04df-4270-829c-a7d5cf1c01b7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:35.876466 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-ecc77214-04df-4270-829c-a7d5cf1c01b7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] HTTP exception thrown: Instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 could not be found. Sep 13 07:07:35.878019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ecc77214-04df-4270-829c-a7d5cf1c01b7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Request method failure captured: Sep 13 07:07:35.878019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 HTTP/1.1 Sep 13 07:07:35.878019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:07:35.878019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:07:35.878019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:07:35.878019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:07:35.878019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:07:35.878019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:07:35.878019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:07:35.878019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:07:35.878019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICt9Lj4_bEAvQVyFr7NuHfrDtiIH3Txfam13pusmwJ6IKF3fVnHbtRtJ8nNxQs_hOFQZdK7LzDouqsp2xWTr2w88N3LQTnQ6Hx_rWq7NNmCxdEIAAANuK_3kHmkwcI5QDGrO9eDBylk8h3swDl36x9AlTa1aIeGwA8hiQzjgxEjU56g Sep 13 07:07:35.878019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:07:35.878019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:07:35.878019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:07:35.878019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:07:35.878019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:07:35.878019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:07:35.878019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: 99bbe5cbd59f4feda4da45f2b14bd09b Sep 13 07:07:35.878019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-TestVolumeBootPattern-2077651277 Sep 13 07:07:35.878019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:07:35.878019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:07:35.879495 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/99bbe5cbd59f4feda4da45f2b14bd09b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bbe5cbd59f4feda4da45f2b14bd09b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bbe5cbd59f4feda4da45f2b14bd09b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_99bbe5cbd59f4feda4da45f2b14bd09b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:07:35.879495 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-TestVolumeBootPattern-2077651277 Sep 13 07:07:35.879495 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 99bbe5cbd59f4feda4da45f2b14bd09b Sep 13 07:07:35.879495 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-TestVolumeBootPattern-2077651277 Sep 13 07:07:35.879495 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-TestVolumeBootPattern-2077651277-project Sep 13 07:07:35.879495 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:07:35.879495 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:07:35.879495 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: 67fa873d16414749bc478a59de3ec5b4 Sep 13 07:07:35.879495 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-TestVolumeBootPattern-2077651277-project Sep 13 07:07:35.879495 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:07:35.879495 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 could not be found. Sep 13 07:07:35.879495 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': 'df5f6f23-54e8-43b0-a5a3-6e336b2a3582'} Sep 13 07:07:35.880328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:07:35.880328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:35.880328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:07:35.880328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:07:35.880328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:07:35.880328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:07:35.880328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:07:35.880328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:07:35.880328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:07:35.880328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:07:35.880328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 could not be found. Sep 13 07:07:35.880328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:35.880328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:07:35.880328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:35.880328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:35.880328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:07:35.880328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:07:35.880328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:07:35.880328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:07:35.880328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:07:35.881605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:07:35.881605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:07:35.881605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:07:35.881605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:07:35.881605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:07:35.881605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:07:35.881605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:07:35.881605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 could not be found. Sep 13 07:07:35.881605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:35.881605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:07:35.881605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:35.881605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:35.881605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:07:35.881605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:07:35.881605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:07:35.881605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:07:35.881605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 could not be found. Sep 13 07:07:35.881605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:35.882857 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ecc77214-04df-4270-829c-a7d5cf1c01b7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Returning 404 to user: Instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:07:35.882857 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ecc77214-04df-4270-829c-a7d5cf1c01b7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 404 len: 111 microversion: 2.1 time: 0.035195 Sep 13 07:07:35.897522 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 409/849] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:35 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:07:35.898180 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-00e03024-b536-4af6-98b1-7a2d7fc82c87 req-29dbc18d-458c-48f5-843f-ab4320446182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1166e7-c092-4bde-b87c-cb8aaa1918da", "name": "network-vif-plugged", "status": "completed", "tag": "dc830de4-1081-4c18-ada7-433d5588216c"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:07:35.909713 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-00e03024-b536-4af6-98b1-7a2d7fc82c87 req-29dbc18d-458c-48f5-843f-ab4320446182 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:35.910203 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-00e03024-b536-4af6-98b1-7a2d7fc82c87 req-29dbc18d-458c-48f5-843f-ab4320446182 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:35.910622 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-00e03024-b536-4af6-98b1-7a2d7fc82c87 req-29dbc18d-458c-48f5-843f-ab4320446182 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:35.922552 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-00e03024-b536-4af6-98b1-7a2d7fc82c87 req-29dbc18d-458c-48f5-843f-ab4320446182 service nova] Creating event network-vif-plugged:dc830de4-1081-4c18-ada7-433d5588216c for instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da on hv-cinder-85694 Sep 13 07:07:35.928800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-00e03024-b536-4af6-98b1-7a2d7fc82c87 req-29dbc18d-458c-48f5-843f-ab4320446182 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037431 Sep 13 07:07:35.929393 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 441/850] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:07:35.989051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7e4d82c3-6a03-49b1-9149-7ba9b4f79b89 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-448482265", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-206741384", "security_groups": [{"name": "tempest-secgroup-smoke-2025561016"}], "block_device_mapping_v2": [{"uuid": "835ab3f4-ff9b-4be6-ab3e-1d2321efee28", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3420c970-55c8-47dc-908b-5f5f431cebe9"}]}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:07:36.105792 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-7e4d82c3-6a03-49b1-9149-7ba9b4f79b89 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] validate_networks() for [('3420c970-55c8-47dc-908b-5f5f431cebe9', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:07:36.571079 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-7e4d82c3-6a03-49b1-9149-7ba9b4f79b89 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:07:36.571503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-7e4d82c3-6a03-49b1-9149-7ba9b4f79b89 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:07:36.571979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-7e4d82c3-6a03-49b1-9149-7ba9b4f79b89 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:07:36.572388 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-7e4d82c3-6a03-49b1-9149-7ba9b4f79b89 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:07:36.572796 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-7e4d82c3-6a03-49b1-9149-7ba9b4f79b89 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:07:36.585178 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7e4d82c3-6a03-49b1-9149-7ba9b4f79b89 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:36.585817 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7e4d82c3-6a03-49b1-9149-7ba9b4f79b89 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:36.586296 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7e4d82c3-6a03-49b1-9149-7ba9b4f79b89 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:36.587015 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7e4d82c3-6a03-49b1-9149-7ba9b4f79b89 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:36.587458 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7e4d82c3-6a03-49b1-9149-7ba9b4f79b89 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:36.587873 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7e4d82c3-6a03-49b1-9149-7ba9b4f79b89 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:36.606685 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-7e4d82c3-6a03-49b1-9149-7ba9b4f79b89 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Getting quotas for project 99bbe5cbd59f4feda4da45f2b14bd09b. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:07:36.610902 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-7e4d82c3-6a03-49b1-9149-7ba9b4f79b89 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Getting quotas for user 67fa873d16414749bc478a59de3ec5b4 and project 99bbe5cbd59f4feda4da45f2b14bd09b. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:07:36.622988 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1444a5bd-e748-4f77-99aa-f48f5158b336 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:36.623790 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1444a5bd-e748-4f77-99aa-f48f5158b336 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:36.631378 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1444a5bd-e748-4f77-99aa-f48f5158b336 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:36.631506 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1444a5bd-e748-4f77-99aa-f48f5158b336 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:36.631919 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1444a5bd-e748-4f77-99aa-f48f5158b336 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:36.632658 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1444a5bd-e748-4f77-99aa-f48f5158b336 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:36.633318 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1444a5bd-e748-4f77-99aa-f48f5158b336 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:36.633907 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1444a5bd-e748-4f77-99aa-f48f5158b336 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:36.657779 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-1444a5bd-e748-4f77-99aa-f48f5158b336 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] HTTP exception thrown: Instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 could not be found. Sep 13 07:07:36.659523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1444a5bd-e748-4f77-99aa-f48f5158b336 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Request method failure captured: Sep 13 07:07:36.659523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 HTTP/1.1 Sep 13 07:07:36.659523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:07:36.659523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:07:36.659523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:07:36.659523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:07:36.659523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:07:36.659523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:07:36.659523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:07:36.659523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:07:36.659523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICqyV8ZDoWvOKN7yB2xTUSeGEw-19LbL5z3b7FCDIrTHuyvYi1pO573AgmLpQMkZe3-u2HyPkAvEThrpkgPF3Y3DpDsAGrmh9FoN2kYrWow6jJnFAoIJGNoEoe53GgBmZUC7q0mN4-e6vnmtsq8cJkNCfkZrjfSjeL4PS70F44wGPd0 Sep 13 07:07:36.659523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:07:36.659523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:07:36.659523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:07:36.659523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:07:36.659523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:07:36.659523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:07:36.659523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:07:36.659523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:36.659523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:07:36.659523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:07:36.661075 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8c7dc05c1c9d40b2bb0defc9dd157d6e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:07:36.661075 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:36.661075 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:07:36.661075 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:36.661075 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:07:36.661075 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:07:36.661075 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:07:36.661075 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 5a0fd7347cad41bc80f427f872cf78fa Sep 13 07:07:36.661075 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:07:36.661075 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:07:36.661075 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 could not be found. Sep 13 07:07:36.661075 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': 'e0e5c5ee-a0fa-47a6-9040-6f84ec08df56'} Sep 13 07:07:36.661965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:07:36.661965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:36.661965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:07:36.661965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:07:36.661965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:07:36.661965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:07:36.661965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:07:36.661965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:07:36.661965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:07:36.661965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:07:36.661965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 could not be found. Sep 13 07:07:36.661965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:36.661965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:07:36.661965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:36.661965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:36.661965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:07:36.661965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:07:36.661965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:07:36.661965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:07:36.661965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:07:36.663509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:07:36.663509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 07:07:36.663509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 07:07:36.663509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 07:07:36.663509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 07:07:36.663509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:07:36.663509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:07:36.663509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:07:36.663509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:07:36.663509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 could not be found. Sep 13 07:07:36.663509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:36.663509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:07:36.663509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:36.663509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:36.663509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:07:36.663509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:07:36.663509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:07:36.663509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:07:36.663509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 could not be found. Sep 13 07:07:36.663509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:36.666521 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1444a5bd-e748-4f77-99aa-f48f5158b336 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Returning 404 to user: Instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:07:36.666521 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1444a5bd-e748-4f77-99aa-f48f5158b336 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 404 len: 111 microversion: 2.1 time: 0.043081 Sep 13 07:07:36.666521 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 442/851] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:07:36 2022] DELETE /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:07:36.670150 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-67bb430a-c8b8-405c-93d7-e434da6922c7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:36.670763 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-67bb430a-c8b8-405c-93d7-e434da6922c7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: e0e5c5ee-a0fa-47a6-9040-6f84ec08df56] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:36.675201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7e4d82c3-6a03-49b1-9149-7ba9b4f79b89 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:07:36.676708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-67bb430a-c8b8-405c-93d7-e434da6922c7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:36.677188 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-67bb430a-c8b8-405c-93d7-e434da6922c7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:36.677341 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7e4d82c3-6a03-49b1-9149-7ba9b4f79b89 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='835ab3f4-ff9b-4be6-ab3e-1d2321efee28',volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:07:36.677619 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-67bb430a-c8b8-405c-93d7-e434da6922c7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:36.678357 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-67bb430a-c8b8-405c-93d7-e434da6922c7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:36.678805 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-67bb430a-c8b8-405c-93d7-e434da6922c7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:36.679268 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-67bb430a-c8b8-405c-93d7-e434da6922c7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:36.697158 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-67bb430a-c8b8-405c-93d7-e434da6922c7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] HTTP exception thrown: Instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 could not be found. Sep 13 07:07:36.698731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-67bb430a-c8b8-405c-93d7-e434da6922c7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Request method failure captured: Sep 13 07:07:36.698731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 HTTP/1.1 Sep 13 07:07:36.698731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:07:36.698731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:07:36.698731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:07:36.698731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:07:36.698731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:07:36.698731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:07:36.698731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:07:36.698731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:07:36.698731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICqyV8ZDoWvOKN7yB2xTUSeGEw-19LbL5z3b7FCDIrTHuyvYi1pO573AgmLpQMkZe3-u2HyPkAvEThrpkgPF3Y3DpDsAGrmh9FoN2kYrWow6jJnFAoIJGNoEoe53GgBmZUC7q0mN4-e6vnmtsq8cJkNCfkZrjfSjeL4PS70F44wGPd0 Sep 13 07:07:36.698731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:07:36.698731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:07:36.698731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:07:36.698731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:07:36.698731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:07:36.698731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:07:36.698731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:07:36.698731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:36.698731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:07:36.698731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:07:36.700361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8c7dc05c1c9d40b2bb0defc9dd157d6e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:07:36.700361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:36.700361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:07:36.700361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:36.700361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:07:36.700361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:07:36.700361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:07:36.700361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 5a0fd7347cad41bc80f427f872cf78fa Sep 13 07:07:36.700361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:07:36.700361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:07:36.700361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 could not be found. Sep 13 07:07:36.700361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': 'e0e5c5ee-a0fa-47a6-9040-6f84ec08df56'} Sep 13 07:07:36.701413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:07:36.701413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:36.701413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:07:36.701413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:07:36.701413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:07:36.701413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:07:36.701413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:07:36.701413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:07:36.701413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:07:36.701413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:07:36.701413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 could not be found. Sep 13 07:07:36.701413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:36.701413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:07:36.701413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:36.701413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:36.701413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:07:36.701413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:07:36.701413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:07:36.701413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:07:36.701413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:07:36.702917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:07:36.702917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:07:36.702917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:07:36.702917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:07:36.702917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:07:36.702917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:07:36.702917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:07:36.702917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 could not be found. Sep 13 07:07:36.702917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:36.702917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:07:36.702917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:36.702917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:36.702917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:07:36.702917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:07:36.702917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:07:36.702917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:07:36.702917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 could not be found. Sep 13 07:07:36.702917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:36.710721 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-67bb430a-c8b8-405c-93d7-e434da6922c7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Returning 404 to user: Instance e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:07:36.710721 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-67bb430a-c8b8-405c-93d7-e434da6922c7 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56" status: 404 len: 111 microversion: 2.1 time: 0.033724 Sep 13 07:07:36.710721 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 443/852] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:36 2022] GET /compute/v2.1/servers/e0e5c5ee-a0fa-47a6-9040-6f84ec08df56 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:07:36.710721 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3d38986e-82e4-4b06-84dc-c7cda9969373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:36.710721 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3d38986e-82e4-4b06-84dc-c7cda9969373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:36.715958 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d38986e-82e4-4b06-84dc-c7cda9969373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:36.716417 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d38986e-82e4-4b06-84dc-c7cda9969373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:36.716861 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d38986e-82e4-4b06-84dc-c7cda9969373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:36.717729 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d38986e-82e4-4b06-84dc-c7cda9969373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:36.717971 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d38986e-82e4-4b06-84dc-c7cda9969373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:36.718421 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d38986e-82e4-4b06-84dc-c7cda9969373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:36.837856 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7e4d82c3-6a03-49b1-9149-7ba9b4f79b89 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.852650 Sep 13 07:07:36.838800 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 410/853] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Sep 13 07:07:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 07:07:36.843400 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8be1e084-97b0-432e-9dc1-1200608a1e61 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:36.844210 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8be1e084-97b0-432e-9dc1-1200608a1e61 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:36.851685 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8be1e084-97b0-432e-9dc1-1200608a1e61 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:36.852546 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8be1e084-97b0-432e-9dc1-1200608a1e61 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:36.853132 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8be1e084-97b0-432e-9dc1-1200608a1e61 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:36.854312 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8be1e084-97b0-432e-9dc1-1200608a1e61 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:36.854927 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8be1e084-97b0-432e-9dc1-1200608a1e61 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:36.855503 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8be1e084-97b0-432e-9dc1-1200608a1e61 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:36.915334 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3d38986e-82e4-4b06-84dc-c7cda9969373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:36.924160 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3d38986e-82e4-4b06-84dc-c7cda9969373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:36.925833 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3d38986e-82e4-4b06-84dc-c7cda9969373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:36.927245 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3d38986e-82e4-4b06-84dc-c7cda9969373 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1731 microversion: 2.20 time: 0.222629 Sep 13 07:07:36.935462 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 444/854] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:36 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1731 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:36.935462 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-27797598-be08-46cc-8382-54502598d320 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:36.935856 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-27797598-be08-46cc-8382-54502598d320 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:37.026722 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-27797598-be08-46cc-8382-54502598d320 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:37.034597 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-27797598-be08-46cc-8382-54502598d320 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 200 len: 1093 microversion: 2.1 time: 0.104476 Sep 13 07:07:37.035843 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 445/855] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:36 2022] GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 1093 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:37.066719 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8be1e084-97b0-432e-9dc1-1200608a1e61 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:37.076027 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8be1e084-97b0-432e-9dc1-1200608a1e61 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1576 microversion: 2.1 time: 0.236143 Sep 13 07:07:37.076589 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 411/856] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:36 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1576 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:37.888177 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3792dcb1-4fc1-45e1-a448-e208e01c0c50 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:37.889394 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3792dcb1-4fc1-45e1-a448-e208e01c0c50 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:37.897081 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3792dcb1-4fc1-45e1-a448-e208e01c0c50 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:37.897648 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3792dcb1-4fc1-45e1-a448-e208e01c0c50 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:37.898305 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3792dcb1-4fc1-45e1-a448-e208e01c0c50 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:37.899711 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3792dcb1-4fc1-45e1-a448-e208e01c0c50 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:37.900228 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3792dcb1-4fc1-45e1-a448-e208e01c0c50 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:37.900697 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3792dcb1-4fc1-45e1-a448-e208e01c0c50 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:37.915771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-3792dcb1-4fc1-45e1-a448-e208e01c0c50 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] HTTP exception thrown: Instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 could not be found. Sep 13 07:07:37.917423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3792dcb1-4fc1-45e1-a448-e208e01c0c50 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Request method failure captured: Sep 13 07:07:37.917423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 HTTP/1.1 Sep 13 07:07:37.917423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:07:37.917423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:07:37.917423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:07:37.917423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:07:37.917423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:07:37.917423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:07:37.917423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:07:37.917423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:07:37.917423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICqyV8ZDoWvOKN7yB2xTUSeGEw-19LbL5z3b7FCDIrTHuyvYi1pO573AgmLpQMkZe3-u2HyPkAvEThrpkgPF3Y3DpDsAGrmh9FoN2kYrWow6jJnFAoIJGNoEoe53GgBmZUC7q0mN4-e6vnmtsq8cJkNCfkZrjfSjeL4PS70F44wGPd0 Sep 13 07:07:37.917423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:07:37.917423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:07:37.917423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:07:37.917423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:07:37.917423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:07:37.917423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:07:37.917423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:07:37.917423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:37.917423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:07:37.917423 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:07:37.919019 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8c7dc05c1c9d40b2bb0defc9dd157d6e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:07:37.919019 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:37.919019 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:07:37.919019 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:37.919019 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:07:37.919019 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:07:37.919019 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:07:37.919019 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 5a0fd7347cad41bc80f427f872cf78fa Sep 13 07:07:37.919019 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:07:37.919019 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:07:37.919019 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 could not be found. Sep 13 07:07:37.919019 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': '2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1'} Sep 13 07:07:37.919967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:07:37.919967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:37.919967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:07:37.919967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:07:37.919967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:07:37.919967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:07:37.919967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:07:37.919967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:07:37.919967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:07:37.919967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:07:37.919967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 could not be found. Sep 13 07:07:37.919967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:37.919967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:07:37.919967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:37.919967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:37.919967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:07:37.919967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:07:37.919967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:07:37.919967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:07:37.919967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:07:37.921523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:07:37.921523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 07:07:37.921523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 07:07:37.921523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 07:07:37.921523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 07:07:37.921523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:07:37.921523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:07:37.921523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:07:37.921523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:07:37.921523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 could not be found. Sep 13 07:07:37.921523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:37.921523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:07:37.921523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:37.921523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:37.921523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:07:37.921523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:07:37.921523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:07:37.921523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:07:37.921523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 could not be found. Sep 13 07:07:37.921523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:37.923047 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3792dcb1-4fc1-45e1-a448-e208e01c0c50 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Returning 404 to user: Instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:07:37.923047 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3792dcb1-4fc1-45e1-a448-e208e01c0c50 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1" status: 404 len: 111 microversion: 2.1 time: 0.037359 Sep 13 07:07:37.923368 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 446/857] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:07:37 2022] DELETE /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:07:37.932077 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2b8d6a17-6b97-43d4-a3fb-9b5263bf6757 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:37.932687 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2b8d6a17-6b97-43d4-a3fb-9b5263bf6757 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:37.939682 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b8d6a17-6b97-43d4-a3fb-9b5263bf6757 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:37.940166 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b8d6a17-6b97-43d4-a3fb-9b5263bf6757 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:37.940596 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b8d6a17-6b97-43d4-a3fb-9b5263bf6757 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:37.941295 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b8d6a17-6b97-43d4-a3fb-9b5263bf6757 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:37.941744 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b8d6a17-6b97-43d4-a3fb-9b5263bf6757 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:37.942187 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b8d6a17-6b97-43d4-a3fb-9b5263bf6757 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:37.953182 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1cd4aba6-5f7a-4241-ae62-26fc46809cb6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:37.953972 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1cd4aba6-5f7a-4241-ae62-26fc46809cb6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:37.956521 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-2b8d6a17-6b97-43d4-a3fb-9b5263bf6757 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] HTTP exception thrown: Instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 could not be found. Sep 13 07:07:37.958442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2b8d6a17-6b97-43d4-a3fb-9b5263bf6757 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Request method failure captured: Sep 13 07:07:37.958442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 HTTP/1.1 Sep 13 07:07:37.958442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:07:37.958442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:07:37.958442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:07:37.958442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:07:37.958442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:07:37.958442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:07:37.958442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:07:37.958442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:07:37.958442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICqyV8ZDoWvOKN7yB2xTUSeGEw-19LbL5z3b7FCDIrTHuyvYi1pO573AgmLpQMkZe3-u2HyPkAvEThrpkgPF3Y3DpDsAGrmh9FoN2kYrWow6jJnFAoIJGNoEoe53GgBmZUC7q0mN4-e6vnmtsq8cJkNCfkZrjfSjeL4PS70F44wGPd0 Sep 13 07:07:37.958442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:07:37.958442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:07:37.958442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:07:37.958442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:07:37.958442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:07:37.958442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:07:37.958442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:07:37.958442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:37.958442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:07:37.958442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:07:37.960072 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8c7dc05c1c9d40b2bb0defc9dd157d6e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:07:37.960072 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:37.960072 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:07:37.960072 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:37.960072 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:07:37.960072 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:07:37.960072 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:07:37.960072 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: 5a0fd7347cad41bc80f427f872cf78fa Sep 13 07:07:37.960072 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:07:37.960072 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:07:37.960072 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 could not be found. Sep 13 07:07:37.960072 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': '2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1'} Sep 13 07:07:37.961146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:07:37.961146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:37.961146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:07:37.961146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:07:37.961146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:07:37.961146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:07:37.961146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:07:37.961146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:07:37.961146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:07:37.961146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:07:37.961146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 could not be found. Sep 13 07:07:37.961146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:37.961146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:07:37.961146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:37.961146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:37.961146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:07:37.961146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:07:37.961146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:07:37.961146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:07:37.961146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:07:37.962636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:07:37.962636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:07:37.962636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:07:37.962636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:07:37.962636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:07:37.962636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:07:37.962636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:07:37.962636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 could not be found. Sep 13 07:07:37.962636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:37.962636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:07:37.962636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:37.962636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:37.962636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:07:37.962636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:07:37.962636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:07:37.962636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:07:37.962636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 could not be found. Sep 13 07:07:37.962636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:37.963975 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1cd4aba6-5f7a-4241-ae62-26fc46809cb6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:37.963975 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1cd4aba6-5f7a-4241-ae62-26fc46809cb6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:37.963975 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1cd4aba6-5f7a-4241-ae62-26fc46809cb6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:37.963975 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1cd4aba6-5f7a-4241-ae62-26fc46809cb6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:37.964333 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1cd4aba6-5f7a-4241-ae62-26fc46809cb6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:37.964333 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1cd4aba6-5f7a-4241-ae62-26fc46809cb6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:37.965180 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2b8d6a17-6b97-43d4-a3fb-9b5263bf6757 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Returning 404 to user: Instance 2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:07:37.966026 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2b8d6a17-6b97-43d4-a3fb-9b5263bf6757 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1" status: 404 len: 111 microversion: 2.1 time: 0.038384 Sep 13 07:07:37.969623 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 412/858] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:37 2022] GET /compute/v2.1/servers/2f87f51f-15c4-43f5-b62e-ef70c9a9e7d1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:07:37.974783 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-226b2a62-ce4e-4b16-85ec-f2d90ed26d46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:37.975266 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-226b2a62-ce4e-4b16-85ec-f2d90ed26d46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:37.981557 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-226b2a62-ce4e-4b16-85ec-f2d90ed26d46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:37.982040 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-226b2a62-ce4e-4b16-85ec-f2d90ed26d46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:37.982530 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-226b2a62-ce4e-4b16-85ec-f2d90ed26d46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:37.983233 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-226b2a62-ce4e-4b16-85ec-f2d90ed26d46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:37.983676 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-226b2a62-ce4e-4b16-85ec-f2d90ed26d46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:37.984089 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-226b2a62-ce4e-4b16-85ec-f2d90ed26d46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:38.000094 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-226b2a62-ce4e-4b16-85ec-f2d90ed26d46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] HTTP exception thrown: Instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 could not be found. Sep 13 07:07:38.001654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-226b2a62-ce4e-4b16-85ec-f2d90ed26d46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Request method failure captured: Sep 13 07:07:38.001654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: DELETE /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 HTTP/1.1 Sep 13 07:07:38.001654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:07:38.001654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:07:38.001654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:07:38.001654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:07:38.001654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:07:38.001654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:07:38.001654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:07:38.001654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:07:38.001654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICqyV8ZDoWvOKN7yB2xTUSeGEw-19LbL5z3b7FCDIrTHuyvYi1pO573AgmLpQMkZe3-u2HyPkAvEThrpkgPF3Y3DpDsAGrmh9FoN2kYrWow6jJnFAoIJGNoEoe53GgBmZUC7q0mN4-e6vnmtsq8cJkNCfkZrjfSjeL4PS70F44wGPd0 Sep 13 07:07:38.001654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:07:38.001654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:07:38.001654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:07:38.001654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:07:38.001654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:07:38.001654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:07:38.001654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:07:38.001654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:38.001654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:07:38.001654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:07:38.003355 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8c7dc05c1c9d40b2bb0defc9dd157d6e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:07:38.003355 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:38.003355 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:07:38.003355 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:38.003355 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:07:38.003355 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:07:38.003355 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:07:38.003355 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: 5a0fd7347cad41bc80f427f872cf78fa Sep 13 07:07:38.003355 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:07:38.003355 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:07:38.003355 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 could not be found. Sep 13 07:07:38.003355 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': '9e9c0b75-cd49-4a40-bd4c-24ab750fd439'} Sep 13 07:07:38.004108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:07:38.004108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:38.004108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:07:38.004108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:07:38.004108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:07:38.004108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:07:38.004108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:07:38.004108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:07:38.004108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:07:38.004108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:07:38.004108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 could not be found. Sep 13 07:07:38.004108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:38.004108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:07:38.004108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:38.004108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:38.004108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:07:38.004108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:07:38.004108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:07:38.004108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:07:38.004108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:07:38.005411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:07:38.005411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 07:07:38.005411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 07:07:38.005411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 07:07:38.005411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 07:07:38.005411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:07:38.005411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:07:38.005411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:07:38.005411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:07:38.005411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 could not be found. Sep 13 07:07:38.005411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:38.005411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:07:38.005411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:38.005411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:38.005411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:07:38.005411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:07:38.005411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:07:38.005411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:07:38.005411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 could not be found. Sep 13 07:07:38.005411 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:38.007952 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-226b2a62-ce4e-4b16-85ec-f2d90ed26d46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Returning 404 to user: Instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:07:38.007952 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-226b2a62-ce4e-4b16-85ec-f2d90ed26d46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 404 len: 111 microversion: 2.1 time: 0.032179 Sep 13 07:07:38.007952 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 413/859] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:07:37 2022] DELETE /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:07:38.012339 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e4e38748-bc6e-42c7-abe7-af726f016f46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:38.012607 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e4e38748-bc6e-42c7-abe7-af726f016f46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 9e9c0b75-cd49-4a40-bd4c-24ab750fd439] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:38.018884 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4e38748-bc6e-42c7-abe7-af726f016f46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:38.019365 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4e38748-bc6e-42c7-abe7-af726f016f46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:38.020000 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4e38748-bc6e-42c7-abe7-af726f016f46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:38.020706 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4e38748-bc6e-42c7-abe7-af726f016f46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:38.021155 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4e38748-bc6e-42c7-abe7-af726f016f46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:38.021747 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4e38748-bc6e-42c7-abe7-af726f016f46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:38.026486 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=100 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:38.037100 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-e4e38748-bc6e-42c7-abe7-af726f016f46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] HTTP exception thrown: Instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 could not be found. Sep 13 07:07:38.039201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e4e38748-bc6e-42c7-abe7-af726f016f46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Request method failure captured: Sep 13 07:07:38.039201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 HTTP/1.1 Sep 13 07:07:38.039201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:07:38.039201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:07:38.039201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:07:38.039201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:07:38.039201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:07:38.039201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:07:38.039201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:07:38.039201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:07:38.039201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICqyV8ZDoWvOKN7yB2xTUSeGEw-19LbL5z3b7FCDIrTHuyvYi1pO573AgmLpQMkZe3-u2HyPkAvEThrpkgPF3Y3DpDsAGrmh9FoN2kYrWow6jJnFAoIJGNoEoe53GgBmZUC7q0mN4-e6vnmtsq8cJkNCfkZrjfSjeL4PS70F44wGPd0 Sep 13 07:07:38.039201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:07:38.039201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:07:38.039201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:07:38.039201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:07:38.039201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:07:38.039201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:07:38.039201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:07:38.039201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:38.039201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:07:38.039201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:07:38.040681 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8c7dc05c1c9d40b2bb0defc9dd157d6e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:07:38.040681 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:38.040681 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:07:38.040681 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:38.040681 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:07:38.040681 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:07:38.040681 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:07:38.040681 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: 5a0fd7347cad41bc80f427f872cf78fa Sep 13 07:07:38.040681 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:07:38.040681 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:07:38.040681 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 could not be found. Sep 13 07:07:38.040681 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': '9e9c0b75-cd49-4a40-bd4c-24ab750fd439'} Sep 13 07:07:38.041580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:07:38.041580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:38.041580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:07:38.041580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:07:38.041580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:07:38.041580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:07:38.041580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:07:38.041580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:07:38.041580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:07:38.041580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:07:38.041580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 could not be found. Sep 13 07:07:38.041580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:38.041580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:07:38.041580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:38.041580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:38.041580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:07:38.041580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:07:38.041580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:07:38.041580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:07:38.041580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:07:38.042965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:07:38.042965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:07:38.042965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:07:38.042965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:07:38.042965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:07:38.042965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:07:38.042965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:07:38.042965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 could not be found. Sep 13 07:07:38.042965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:38.042965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:07:38.042965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:38.042965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:38.042965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:07:38.042965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:07:38.042965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:07:38.042965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:07:38.042965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 could not be found. Sep 13 07:07:38.042965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:07:38.044871 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e4e38748-bc6e-42c7-abe7-af726f016f46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Returning 404 to user: Instance 9e9c0b75-cd49-4a40-bd4c-24ab750fd439 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:07:38.045854 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e4e38748-bc6e-42c7-abe7-af726f016f46 tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439" status: 404 len: 111 microversion: 2.1 time: 0.038170 Sep 13 07:07:38.047117 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 414/860] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:38 2022] GET /compute/v2.1/servers/9e9c0b75-cd49-4a40-bd4c-24ab750fd439 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:07:38.063410 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-fef1615a-6057-4715-a491-bf2565ec2c97 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:38.064026 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-fef1615a-6057-4715-a491-bf2565ec2c97 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:38.070298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fef1615a-6057-4715-a491-bf2565ec2c97 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:38.071126 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fef1615a-6057-4715-a491-bf2565ec2c97 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:38.072031 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fef1615a-6057-4715-a491-bf2565ec2c97 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:38.073097 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fef1615a-6057-4715-a491-bf2565ec2c97 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:38.073563 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fef1615a-6057-4715-a491-bf2565ec2c97 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:38.073986 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fef1615a-6057-4715-a491-bf2565ec2c97 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:38.137331 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1cd4aba6-5f7a-4241-ae62-26fc46809cb6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:38.146833 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1cd4aba6-5f7a-4241-ae62-26fc46809cb6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:38.148731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1cd4aba6-5f7a-4241-ae62-26fc46809cb6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:38.150164 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1cd4aba6-5f7a-4241-ae62-26fc46809cb6 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1731 microversion: 2.20 time: 0.201158 Sep 13 07:07:38.162570 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 447/861] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:37 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1731 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:38.176566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7ab40f89-780b-4fda-8276-b2f1d8915be6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:38.177514 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7ab40f89-780b-4fda-8276-b2f1d8915be6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:38.184236 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-fef1615a-6057-4715-a491-bf2565ec2c97 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:38.184739 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ab40f89-780b-4fda-8276-b2f1d8915be6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:38.185282 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ab40f89-780b-4fda-8276-b2f1d8915be6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:38.185769 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ab40f89-780b-4fda-8276-b2f1d8915be6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:38.186551 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ab40f89-780b-4fda-8276-b2f1d8915be6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:38.187057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ab40f89-780b-4fda-8276-b2f1d8915be6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:38.187536 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ab40f89-780b-4fda-8276-b2f1d8915be6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:38.192670 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-fef1615a-6057-4715-a491-bf2565ec2c97 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 200 len: 1191 microversion: 2.1 time: 0.132930 Sep 13 07:07:38.209725 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 415/862] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:38 2022] GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 1191 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:38.327002 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7ab40f89-780b-4fda-8276-b2f1d8915be6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:38.338960 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7ab40f89-780b-4fda-8276-b2f1d8915be6 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1576 microversion: 2.1 time: 0.174863 Sep 13 07:07:38.339841 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 448/863] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:38 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:39.182286 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e70a0c98-e578-4f04-97cf-e22b18d95697 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:39.182855 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e70a0c98-e578-4f04-97cf-e22b18d95697 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:39.189724 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e70a0c98-e578-4f04-97cf-e22b18d95697 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:39.189885 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e70a0c98-e578-4f04-97cf-e22b18d95697 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:39.190756 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e70a0c98-e578-4f04-97cf-e22b18d95697 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:39.191678 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e70a0c98-e578-4f04-97cf-e22b18d95697 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:39.192356 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e70a0c98-e578-4f04-97cf-e22b18d95697 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:39.192783 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e70a0c98-e578-4f04-97cf-e22b18d95697 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:39.213709 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5ffa7ab5-2c50-437a-993c-322a5fca64cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:39.214843 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5ffa7ab5-2c50-437a-993c-322a5fca64cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:39.221721 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5ffa7ab5-2c50-437a-993c-322a5fca64cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:39.222246 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5ffa7ab5-2c50-437a-993c-322a5fca64cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:39.222686 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5ffa7ab5-2c50-437a-993c-322a5fca64cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:39.223383 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5ffa7ab5-2c50-437a-993c-322a5fca64cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:39.223833 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5ffa7ab5-2c50-437a-993c-322a5fca64cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:39.224232 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5ffa7ab5-2c50-437a-993c-322a5fca64cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:39.239682 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-5ffa7ab5-2c50-437a-993c-322a5fca64cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] HTTP exception thrown: Instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd could not be found. Sep 13 07:07:39.241218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5ffa7ab5-2c50-437a-993c-322a5fca64cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Request method failure captured: Sep 13 07:07:39.241218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd HTTP/1.1 Sep 13 07:07:39.241218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:07:39.241218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:07:39.241218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:07:39.241218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:07:39.241218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:07:39.241218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:07:39.241218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:07:39.241218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:07:39.241218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICqyV8ZDoWvOKN7yB2xTUSeGEw-19LbL5z3b7FCDIrTHuyvYi1pO573AgmLpQMkZe3-u2HyPkAvEThrpkgPF3Y3DpDsAGrmh9FoN2kYrWow6jJnFAoIJGNoEoe53GgBmZUC7q0mN4-e6vnmtsq8cJkNCfkZrjfSjeL4PS70F44wGPd0 Sep 13 07:07:39.241218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:07:39.241218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:07:39.241218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:07:39.241218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:07:39.241218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:07:39.241218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:07:39.241218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:07:39.241218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:39.241218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:07:39.241218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:07:39.242915 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8c7dc05c1c9d40b2bb0defc9dd157d6e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:07:39.242915 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:39.242915 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:07:39.242915 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:39.242915 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:07:39.242915 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:07:39.242915 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:07:39.242915 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 5a0fd7347cad41bc80f427f872cf78fa Sep 13 07:07:39.242915 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:07:39.242915 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:07:39.242915 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd could not be found. Sep 13 07:07:39.242915 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': '98fc8f3f-7357-45fd-b982-ea283b3b33dd'} Sep 13 07:07:39.244076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:07:39.244076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:39.244076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:07:39.244076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:07:39.244076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:07:39.244076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:07:39.244076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:07:39.244076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:07:39.244076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:07:39.244076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:07:39.244076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd could not be found. Sep 13 07:07:39.244076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:39.244076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:07:39.244076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:39.244076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:39.244076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:07:39.244076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:07:39.244076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:07:39.244076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:07:39.244076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:07:39.245307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:07:39.245307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 07:07:39.245307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 07:07:39.245307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 07:07:39.245307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 07:07:39.245307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:07:39.245307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:07:39.245307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:07:39.245307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:07:39.245307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd could not be found. Sep 13 07:07:39.245307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:39.245307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:07:39.245307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:39.245307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:39.245307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:07:39.245307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:07:39.245307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:07:39.245307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:07:39.245307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd could not be found. Sep 13 07:07:39.245307 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:39.246592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5ffa7ab5-2c50-437a-993c-322a5fca64cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Returning 404 to user: Instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:07:39.246592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5ffa7ab5-2c50-437a-993c-322a5fca64cf tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "DELETE /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 404 len: 111 microversion: 2.1 time: 0.034379 Sep 13 07:07:39.246592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 449/864] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:07:39 2022] DELETE /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:07:39.249644 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8101fc5b-4913-46b0-87fa-43f614f862f5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:39.250290 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8101fc5b-4913-46b0-87fa-43f614f862f5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:39.256289 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8101fc5b-4913-46b0-87fa-43f614f862f5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:39.256800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8101fc5b-4913-46b0-87fa-43f614f862f5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:39.257230 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8101fc5b-4913-46b0-87fa-43f614f862f5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:39.257938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8101fc5b-4913-46b0-87fa-43f614f862f5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:39.258418 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8101fc5b-4913-46b0-87fa-43f614f862f5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:39.258839 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8101fc5b-4913-46b0-87fa-43f614f862f5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:39.263729 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:39.365992 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8101fc5b-4913-46b0-87fa-43f614f862f5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:39.374761 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8101fc5b-4913-46b0-87fa-43f614f862f5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 200 len: 1209 microversion: 2.1 time: 0.129611 Sep 13 07:07:39.375330 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 450/865] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:39 2022] GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 1209 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:39.379797 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-357ea26b-2094-4580-9eb3-49522b662a1a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:39.380402 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-357ea26b-2094-4580-9eb3-49522b662a1a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] [instance: 98fc8f3f-7357-45fd-b982-ea283b3b33dd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:39.386418 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-357ea26b-2094-4580-9eb3-49522b662a1a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:39.386897 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-357ea26b-2094-4580-9eb3-49522b662a1a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:39.387495 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-357ea26b-2094-4580-9eb3-49522b662a1a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:39.388409 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-357ea26b-2094-4580-9eb3-49522b662a1a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:39.388929 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-357ea26b-2094-4580-9eb3-49522b662a1a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:39.389539 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-357ea26b-2094-4580-9eb3-49522b662a1a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:39.404397 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-357ea26b-2094-4580-9eb3-49522b662a1a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] HTTP exception thrown: Instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd could not be found. Sep 13 07:07:39.406285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-357ea26b-2094-4580-9eb3-49522b662a1a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Request method failure captured: Sep 13 07:07:39.406285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd HTTP/1.1 Sep 13 07:07:39.406285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:07:39.406285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:07:39.406285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:07:39.406285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:07:39.406285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:07:39.406285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:07:39.406285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:07:39.406285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:07:39.406285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICqyV8ZDoWvOKN7yB2xTUSeGEw-19LbL5z3b7FCDIrTHuyvYi1pO573AgmLpQMkZe3-u2HyPkAvEThrpkgPF3Y3DpDsAGrmh9FoN2kYrWow6jJnFAoIJGNoEoe53GgBmZUC7q0mN4-e6vnmtsq8cJkNCfkZrjfSjeL4PS70F44wGPd0 Sep 13 07:07:39.406285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:07:39.406285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:07:39.406285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:07:39.406285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:07:39.406285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:07:39.406285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:07:39.406285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:07:39.406285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:39.406285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:07:39.406285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:07:39.407719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c7dc05c1c9d40b2bb0defc9dd157d6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8c7dc05c1c9d40b2bb0defc9dd157d6e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:07:39.407719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:39.407719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 8c7dc05c1c9d40b2bb0defc9dd157d6e Sep 13 07:07:39.407719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186681588 Sep 13 07:07:39.407719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:07:39.407719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:07:39.407719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:07:39.407719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 5a0fd7347cad41bc80f427f872cf78fa Sep 13 07:07:39.407719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-1186681588-project Sep 13 07:07:39.407719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:07:39.407719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd could not be found. Sep 13 07:07:39.407719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': '98fc8f3f-7357-45fd-b982-ea283b3b33dd'} Sep 13 07:07:39.408480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:07:39.408480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:39.408480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:07:39.408480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:07:39.408480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:07:39.408480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:07:39.408480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:07:39.408480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:07:39.408480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:07:39.408480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:07:39.408480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd could not be found. Sep 13 07:07:39.408480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:39.408480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:07:39.408480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:39.408480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:39.408480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:07:39.408480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:07:39.408480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:07:39.408480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:07:39.408480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:07:39.409681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:07:39.409681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:07:39.409681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:07:39.409681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:07:39.409681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:07:39.409681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:07:39.409681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:07:39.409681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd could not be found. Sep 13 07:07:39.409681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:39.409681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:07:39.409681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:39.409681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:07:39.409681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:07:39.409681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:07:39.409681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:07:39.409681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:07:39.409681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd could not be found. Sep 13 07:07:39.409681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:07:39.410822 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-357ea26b-2094-4580-9eb3-49522b662a1a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] Returning 404 to user: Instance 98fc8f3f-7357-45fd-b982-ea283b3b33dd could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:07:39.410822 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-357ea26b-2094-4580-9eb3-49522b662a1a tempest-AttachVolumeNegativeTest-1186681588 tempest-AttachVolumeNegativeTest-1186681588-project] 10.222.0.25 "GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd" status: 404 len: 111 microversion: 2.1 time: 0.031435 Sep 13 07:07:39.410822 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 451/866] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:39 2022] GET /compute/v2.1/servers/98fc8f3f-7357-45fd-b982-ea283b3b33dd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:07:39.412703 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d3aa796c-e8c7-4831-94bf-b89464b043e9 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:39.413313 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d3aa796c-e8c7-4831-94bf-b89464b043e9 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:39.420966 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e70a0c98-e578-4f04-97cf-e22b18d95697 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:39.422691 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3aa796c-e8c7-4831-94bf-b89464b043e9 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:39.423205 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3aa796c-e8c7-4831-94bf-b89464b043e9 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:39.423870 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3aa796c-e8c7-4831-94bf-b89464b043e9 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:39.424349 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3aa796c-e8c7-4831-94bf-b89464b043e9 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:39.424962 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3aa796c-e8c7-4831-94bf-b89464b043e9 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:39.425535 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3aa796c-e8c7-4831-94bf-b89464b043e9 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:39.438510 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e70a0c98-e578-4f04-97cf-e22b18d95697 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:39.440298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e70a0c98-e578-4f04-97cf-e22b18d95697 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:39.441789 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e70a0c98-e578-4f04-97cf-e22b18d95697 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1718 microversion: 2.20 time: 0.264987 Sep 13 07:07:39.443575 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 416/867] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:07:39 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1718 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:07:39.685807 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d3aa796c-e8c7-4831-94bf-b89464b043e9 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:39.701428 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d3aa796c-e8c7-4831-94bf-b89464b043e9 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1576 microversion: 2.1 time: 0.292136 Sep 13 07:07:39.711519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 452/868] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:39 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1576 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:40.401490 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d84a5192-e1f4-4280-a9ba-9534e885b5b2 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:40.402728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d84a5192-e1f4-4280-a9ba-9534e885b5b2 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:40.404568 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-96295e6c-8237-4b6f-86e8-798f0b5d94f7 req-e2436167-3697-4630-8237-f440a49783d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce5618c6-5eed-4097-9add-4943c7251e95", "tag": "8123a51f-2109-4966-a1db-e715035c1e0e"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:07:40.410409 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d84a5192-e1f4-4280-a9ba-9534e885b5b2 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:40.411018 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d84a5192-e1f4-4280-a9ba-9534e885b5b2 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:40.411736 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d84a5192-e1f4-4280-a9ba-9534e885b5b2 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:40.412589 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d84a5192-e1f4-4280-a9ba-9534e885b5b2 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:40.413204 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d84a5192-e1f4-4280-a9ba-9534e885b5b2 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:40.413771 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d84a5192-e1f4-4280-a9ba-9534e885b5b2 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:40.419796 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-96295e6c-8237-4b6f-86e8-798f0b5d94f7 req-e2436167-3697-4630-8237-f440a49783d6 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:40.422712 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-96295e6c-8237-4b6f-86e8-798f0b5d94f7 req-e2436167-3697-4630-8237-f440a49783d6 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:40.423407 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-96295e6c-8237-4b6f-86e8-798f0b5d94f7 req-e2436167-3697-4630-8237-f440a49783d6 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:40.439892 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-96295e6c-8237-4b6f-86e8-798f0b5d94f7 req-e2436167-3697-4630-8237-f440a49783d6 service nova] Creating event network-changed:8123a51f-2109-4966-a1db-e715035c1e0e for instance ce5618c6-5eed-4097-9add-4943c7251e95 on hv-cinder-85694 Sep 13 07:07:40.445976 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-96295e6c-8237-4b6f-86e8-798f0b5d94f7 req-e2436167-3697-4630-8237-f440a49783d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046041 Sep 13 07:07:40.447659 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 453/869] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:07:40.558186 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d84a5192-e1f4-4280-a9ba-9534e885b5b2 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:40.565877 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d84a5192-e1f4-4280-a9ba-9534e885b5b2 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 200 len: 1265 microversion: 2.1 time: 0.168897 Sep 13 07:07:40.566551 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 417/870] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:40 2022] GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:40.726855 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f4188bbb-9c6c-4dde-9457-db5dc77ee9ac tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:40.729673 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f4188bbb-9c6c-4dde-9457-db5dc77ee9ac tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:40.737776 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4188bbb-9c6c-4dde-9457-db5dc77ee9ac tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:40.738574 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4188bbb-9c6c-4dde-9457-db5dc77ee9ac tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:40.739004 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4188bbb-9c6c-4dde-9457-db5dc77ee9ac tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:40.739708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4188bbb-9c6c-4dde-9457-db5dc77ee9ac tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:40.740193 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4188bbb-9c6c-4dde-9457-db5dc77ee9ac tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:40.740609 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4188bbb-9c6c-4dde-9457-db5dc77ee9ac tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:41.241421 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f4188bbb-9c6c-4dde-9457-db5dc77ee9ac tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:41.249727 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f4188bbb-9c6c-4dde-9457-db5dc77ee9ac tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1576 microversion: 2.1 time: 0.528387 Sep 13 07:07:41.267241 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 454/871] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:40 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1576 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:07:41.602955 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c202e2e7-5659-4df1-b05d-9cf88a82aef4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:41.605493 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c202e2e7-5659-4df1-b05d-9cf88a82aef4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:41.619816 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c202e2e7-5659-4df1-b05d-9cf88a82aef4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:41.620548 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c202e2e7-5659-4df1-b05d-9cf88a82aef4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:41.621145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c202e2e7-5659-4df1-b05d-9cf88a82aef4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:41.622305 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c202e2e7-5659-4df1-b05d-9cf88a82aef4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:41.623250 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c202e2e7-5659-4df1-b05d-9cf88a82aef4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:41.624615 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c202e2e7-5659-4df1-b05d-9cf88a82aef4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:41.862848 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c202e2e7-5659-4df1-b05d-9cf88a82aef4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:41.871348 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c202e2e7-5659-4df1-b05d-9cf88a82aef4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 200 len: 1265 microversion: 2.1 time: 0.286250 Sep 13 07:07:41.872613 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 418/872] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:41 2022] GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 1265 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:42.273902 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fb02ac4e-89c2-4f55-b8eb-d6a46de1177e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:42.277890 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fb02ac4e-89c2-4f55-b8eb-d6a46de1177e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:42.285484 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb02ac4e-89c2-4f55-b8eb-d6a46de1177e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:42.286334 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb02ac4e-89c2-4f55-b8eb-d6a46de1177e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:42.287129 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb02ac4e-89c2-4f55-b8eb-d6a46de1177e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:42.288086 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb02ac4e-89c2-4f55-b8eb-d6a46de1177e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:42.288742 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb02ac4e-89c2-4f55-b8eb-d6a46de1177e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:42.289528 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb02ac4e-89c2-4f55-b8eb-d6a46de1177e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:42.444767 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fb02ac4e-89c2-4f55-b8eb-d6a46de1177e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:42.452926 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fb02ac4e-89c2-4f55-b8eb-d6a46de1177e tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1576 microversion: 2.1 time: 0.183201 Sep 13 07:07:42.453504 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 455/873] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:42 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:42.897818 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b33a8c7f-79c2-4f6c-b9cf-0b65ff18ca0a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:42.898478 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b33a8c7f-79c2-4f6c-b9cf-0b65ff18ca0a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:42.905653 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b33a8c7f-79c2-4f6c-b9cf-0b65ff18ca0a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:42.906069 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b33a8c7f-79c2-4f6c-b9cf-0b65ff18ca0a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:42.906629 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b33a8c7f-79c2-4f6c-b9cf-0b65ff18ca0a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:42.907328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b33a8c7f-79c2-4f6c-b9cf-0b65ff18ca0a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:42.907782 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b33a8c7f-79c2-4f6c-b9cf-0b65ff18ca0a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:42.908200 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b33a8c7f-79c2-4f6c-b9cf-0b65ff18ca0a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:43.082124 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b33a8c7f-79c2-4f6c-b9cf-0b65ff18ca0a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:43.089977 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b33a8c7f-79c2-4f6c-b9cf-0b65ff18ca0a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 200 len: 1265 microversion: 2.1 time: 0.196845 Sep 13 07:07:43.090821 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 419/874] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:42 2022] GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:43.478523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-03ce0adf-057f-4287-919e-b396cb2331e9 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:43.479721 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-03ce0adf-057f-4287-919e-b396cb2331e9 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:43.488871 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03ce0adf-057f-4287-919e-b396cb2331e9 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:43.489373 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03ce0adf-057f-4287-919e-b396cb2331e9 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:43.489849 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03ce0adf-057f-4287-919e-b396cb2331e9 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:43.490704 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03ce0adf-057f-4287-919e-b396cb2331e9 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:43.491015 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03ce0adf-057f-4287-919e-b396cb2331e9 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:43.491433 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03ce0adf-057f-4287-919e-b396cb2331e9 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:43.627798 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-03ce0adf-057f-4287-919e-b396cb2331e9 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:43.635928 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-03ce0adf-057f-4287-919e-b396cb2331e9 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1576 microversion: 2.1 time: 0.162776 Sep 13 07:07:43.636484 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 456/875] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:43 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:44.112825 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-61d01d6c-c26f-484d-90ee-4ba7530ccc8f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:44.113427 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-61d01d6c-c26f-484d-90ee-4ba7530ccc8f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:44.120617 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61d01d6c-c26f-484d-90ee-4ba7530ccc8f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:44.121102 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61d01d6c-c26f-484d-90ee-4ba7530ccc8f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:44.121527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61d01d6c-c26f-484d-90ee-4ba7530ccc8f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:44.122253 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61d01d6c-c26f-484d-90ee-4ba7530ccc8f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:44.122705 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61d01d6c-c26f-484d-90ee-4ba7530ccc8f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:44.123126 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61d01d6c-c26f-484d-90ee-4ba7530ccc8f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:44.324057 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-61d01d6c-c26f-484d-90ee-4ba7530ccc8f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:44.332611 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-61d01d6c-c26f-484d-90ee-4ba7530ccc8f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 200 len: 1265 microversion: 2.1 time: 0.223637 Sep 13 07:07:44.333157 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 420/876] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:44 2022] GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:44.660055 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ec4a69af-0ed1-4aa1-ae27-63f5980f0aaf tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:44.660883 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ec4a69af-0ed1-4aa1-ae27-63f5980f0aaf tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:44.667952 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ec4a69af-0ed1-4aa1-ae27-63f5980f0aaf tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:44.668595 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ec4a69af-0ed1-4aa1-ae27-63f5980f0aaf tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:44.669180 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ec4a69af-0ed1-4aa1-ae27-63f5980f0aaf tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:44.669930 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ec4a69af-0ed1-4aa1-ae27-63f5980f0aaf tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:44.670602 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ec4a69af-0ed1-4aa1-ae27-63f5980f0aaf tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:44.671112 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ec4a69af-0ed1-4aa1-ae27-63f5980f0aaf tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:44.816153 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ec4a69af-0ed1-4aa1-ae27-63f5980f0aaf tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:44.826835 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ec4a69af-0ed1-4aa1-ae27-63f5980f0aaf tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1576 microversion: 2.1 time: 0.170640 Sep 13 07:07:44.830127 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 457/877] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:44 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:45.357117 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-262795ab-b191-4496-8fc9-dd6cbab66c2a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:45.357799 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-262795ab-b191-4496-8fc9-dd6cbab66c2a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:45.364045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-262795ab-b191-4496-8fc9-dd6cbab66c2a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:45.364602 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-262795ab-b191-4496-8fc9-dd6cbab66c2a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:45.365103 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-262795ab-b191-4496-8fc9-dd6cbab66c2a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:45.365874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-262795ab-b191-4496-8fc9-dd6cbab66c2a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:45.366425 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-262795ab-b191-4496-8fc9-dd6cbab66c2a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:45.366847 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-262795ab-b191-4496-8fc9-dd6cbab66c2a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:45.510152 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-262795ab-b191-4496-8fc9-dd6cbab66c2a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:45.518550 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-262795ab-b191-4496-8fc9-dd6cbab66c2a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 200 len: 1265 microversion: 2.1 time: 0.165414 Sep 13 07:07:45.519462 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 421/878] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:45 2022] GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:45.851663 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bb4e959c-eda3-440d-aa1e-78686193d6a3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:45.852871 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bb4e959c-eda3-440d-aa1e-78686193d6a3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:45.862717 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb4e959c-eda3-440d-aa1e-78686193d6a3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:45.863358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb4e959c-eda3-440d-aa1e-78686193d6a3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:45.863908 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb4e959c-eda3-440d-aa1e-78686193d6a3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:45.864679 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb4e959c-eda3-440d-aa1e-78686193d6a3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:45.865206 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb4e959c-eda3-440d-aa1e-78686193d6a3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:45.865824 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb4e959c-eda3-440d-aa1e-78686193d6a3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:46.019835 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bb4e959c-eda3-440d-aa1e-78686193d6a3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:46.028587 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bb4e959c-eda3-440d-aa1e-78686193d6a3 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1576 microversion: 2.1 time: 0.182619 Sep 13 07:07:46.029451 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 458/879] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:45 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:46.029818 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-63b4d3c3-86d5-4530-ada6-8717e8bcbe0f req-48ad44ab-e85a-4d8e-8d3f-6374afc687b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d695cc83-d3c5-44c9-af4a-2f0e67a96adf", "name": "network-vif-plugged", "status": "completed", "tag": "a7477596-3b59-40f9-9676-9d56b3b3aba4"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:07:46.045300 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-63b4d3c3-86d5-4530-ada6-8717e8bcbe0f req-48ad44ab-e85a-4d8e-8d3f-6374afc687b8 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:46.046557 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-63b4d3c3-86d5-4530-ada6-8717e8bcbe0f req-48ad44ab-e85a-4d8e-8d3f-6374afc687b8 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:46.047412 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-63b4d3c3-86d5-4530-ada6-8717e8bcbe0f req-48ad44ab-e85a-4d8e-8d3f-6374afc687b8 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:46.064212 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-63b4d3c3-86d5-4530-ada6-8717e8bcbe0f req-48ad44ab-e85a-4d8e-8d3f-6374afc687b8 service nova] Creating event network-vif-plugged:a7477596-3b59-40f9-9676-9d56b3b3aba4 for instance d695cc83-d3c5-44c9-af4a-2f0e67a96adf on hv-cinder-85694 Sep 13 07:07:46.069047 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-63b4d3c3-86d5-4530-ada6-8717e8bcbe0f req-48ad44ab-e85a-4d8e-8d3f-6374afc687b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046284 Sep 13 07:07:46.069636 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 422/880] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:07:46.541400 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b8ead685-fc42-4d7d-99de-433e48c07e11 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:46.541946 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b8ead685-fc42-4d7d-99de-433e48c07e11 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:46.548854 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8ead685-fc42-4d7d-99de-433e48c07e11 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:46.549350 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8ead685-fc42-4d7d-99de-433e48c07e11 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:46.549784 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8ead685-fc42-4d7d-99de-433e48c07e11 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:46.550505 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8ead685-fc42-4d7d-99de-433e48c07e11 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:46.550957 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8ead685-fc42-4d7d-99de-433e48c07e11 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:46.551381 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8ead685-fc42-4d7d-99de-433e48c07e11 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:46.770793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b8ead685-fc42-4d7d-99de-433e48c07e11 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:46.779392 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b8ead685-fc42-4d7d-99de-433e48c07e11 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 200 len: 1265 microversion: 2.1 time: 0.242335 Sep 13 07:07:46.782164 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 459/881] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:46 2022] GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:47.052680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:47.053468 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=6 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:47.058120 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6f04401a-8951-46e2-8618-08f5ea87f8bc tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:47.058820 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6f04401a-8951-46e2-8618-08f5ea87f8bc tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:47.065932 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f04401a-8951-46e2-8618-08f5ea87f8bc tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:47.066441 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f04401a-8951-46e2-8618-08f5ea87f8bc tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:47.066862 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f04401a-8951-46e2-8618-08f5ea87f8bc tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:47.067544 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f04401a-8951-46e2-8618-08f5ea87f8bc tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:47.068029 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f04401a-8951-46e2-8618-08f5ea87f8bc tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:47.068422 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f04401a-8951-46e2-8618-08f5ea87f8bc tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:47.304917 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6f04401a-8951-46e2-8618-08f5ea87f8bc tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:47.315126 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6f04401a-8951-46e2-8618-08f5ea87f8bc tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1576 microversion: 2.1 time: 0.263861 Sep 13 07:07:47.330786 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 423/882] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:47 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1576 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:47.803357 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4b6c4da7-2a30-4464-ae43-0842ad63670f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:47.804003 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4b6c4da7-2a30-4464-ae43-0842ad63670f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:47.807606 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:47.813189 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b6c4da7-2a30-4464-ae43-0842ad63670f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:47.813674 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b6c4da7-2a30-4464-ae43-0842ad63670f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:47.814140 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b6c4da7-2a30-4464-ae43-0842ad63670f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:47.815470 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b6c4da7-2a30-4464-ae43-0842ad63670f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:47.815914 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b6c4da7-2a30-4464-ae43-0842ad63670f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:47.816514 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b6c4da7-2a30-4464-ae43-0842ad63670f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:47.964941 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4b6c4da7-2a30-4464-ae43-0842ad63670f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:47.972825 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4b6c4da7-2a30-4464-ae43-0842ad63670f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 200 len: 1265 microversion: 2.1 time: 0.173665 Sep 13 07:07:47.973585 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 460/883] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:47 2022] GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:48.340029 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bcdaed76-e14b-41f4-82a6-055dd331f831 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:48.340608 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bcdaed76-e14b-41f4-82a6-055dd331f831 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:48.355033 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bcdaed76-e14b-41f4-82a6-055dd331f831 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:48.355510 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bcdaed76-e14b-41f4-82a6-055dd331f831 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:48.355934 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bcdaed76-e14b-41f4-82a6-055dd331f831 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:48.356854 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bcdaed76-e14b-41f4-82a6-055dd331f831 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:48.358296 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bcdaed76-e14b-41f4-82a6-055dd331f831 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:48.358724 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bcdaed76-e14b-41f4-82a6-055dd331f831 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:48.498927 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bcdaed76-e14b-41f4-82a6-055dd331f831 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:48.506907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bcdaed76-e14b-41f4-82a6-055dd331f831 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1563 microversion: 2.1 time: 0.170997 Sep 13 07:07:48.507538 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 424/884] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:48 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:48.749042 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b7f395fc-7338-43e3-905f-797f15270085 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:48.749529 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b7f395fc-7338-43e3-905f-797f15270085 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:48.756193 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b7f395fc-7338-43e3-905f-797f15270085 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:48.756677 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b7f395fc-7338-43e3-905f-797f15270085 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:48.757097 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b7f395fc-7338-43e3-905f-797f15270085 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:48.757806 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b7f395fc-7338-43e3-905f-797f15270085 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:48.758435 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b7f395fc-7338-43e3-905f-797f15270085 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:48.758976 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b7f395fc-7338-43e3-905f-797f15270085 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:48.782872 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b7f395fc-7338-43e3-905f-797f15270085 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7/ips" status: 200 len: 146 microversion: 2.1 time: 0.037690 Sep 13 07:07:48.783777 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 461/885] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Sep 13 07:07:48 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:07:48.995904 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a7709275-1a54-4be3-86da-2af6cf124706 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:48.996510 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a7709275-1a54-4be3-86da-2af6cf124706 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:49.002750 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a7709275-1a54-4be3-86da-2af6cf124706 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:49.003227 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a7709275-1a54-4be3-86da-2af6cf124706 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:49.003652 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a7709275-1a54-4be3-86da-2af6cf124706 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:49.004342 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a7709275-1a54-4be3-86da-2af6cf124706 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:49.004784 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a7709275-1a54-4be3-86da-2af6cf124706 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:49.005222 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a7709275-1a54-4be3-86da-2af6cf124706 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:49.137049 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a7709275-1a54-4be3-86da-2af6cf124706 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:49.145291 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a7709275-1a54-4be3-86da-2af6cf124706 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 200 len: 1265 microversion: 2.1 time: 0.153900 Sep 13 07:07:49.145871 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 425/886] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:48 2022] GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:50.169195 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6cddd947-5457-4e34-b336-d8c96862fab7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:50.169957 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6cddd947-5457-4e34-b336-d8c96862fab7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:50.176810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6cddd947-5457-4e34-b336-d8c96862fab7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:50.177539 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6cddd947-5457-4e34-b336-d8c96862fab7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:50.177754 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6cddd947-5457-4e34-b336-d8c96862fab7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:50.178776 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6cddd947-5457-4e34-b336-d8c96862fab7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:50.179411 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6cddd947-5457-4e34-b336-d8c96862fab7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:50.179971 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6cddd947-5457-4e34-b336-d8c96862fab7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:50.340275 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6cddd947-5457-4e34-b336-d8c96862fab7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:50.353178 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6cddd947-5457-4e34-b336-d8c96862fab7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 200 len: 1265 microversion: 2.1 time: 0.188182 Sep 13 07:07:50.353901 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 462/887] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:50 2022] GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:51.376715 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4fc322bc-8b0c-43ed-a385-bb8ee014fb3c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:51.377293 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4fc322bc-8b0c-43ed-a385-bb8ee014fb3c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:51.384065 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4fc322bc-8b0c-43ed-a385-bb8ee014fb3c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:51.384560 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4fc322bc-8b0c-43ed-a385-bb8ee014fb3c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:51.384988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4fc322bc-8b0c-43ed-a385-bb8ee014fb3c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:51.385674 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4fc322bc-8b0c-43ed-a385-bb8ee014fb3c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:51.386116 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4fc322bc-8b0c-43ed-a385-bb8ee014fb3c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:51.386532 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4fc322bc-8b0c-43ed-a385-bb8ee014fb3c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:51.523794 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4fc322bc-8b0c-43ed-a385-bb8ee014fb3c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:51.532369 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4fc322bc-8b0c-43ed-a385-bb8ee014fb3c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 200 len: 1265 microversion: 2.1 time: 0.159545 Sep 13 07:07:51.533447 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 426/888] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:51 2022] GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:51.614969 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b9dada26-4cff-40ac-8f5f-ab5478bba799 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eea7e092-9238-469f-b26c-2c0142311e3e"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:07:51.617376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b9dada26-4cff-40ac-8f5f-ab5478bba799 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:51.624496 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9dada26-4cff-40ac-8f5f-ab5478bba799 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:51.624987 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9dada26-4cff-40ac-8f5f-ab5478bba799 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:51.625413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9dada26-4cff-40ac-8f5f-ab5478bba799 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:51.626153 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9dada26-4cff-40ac-8f5f-ab5478bba799 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:51.626604 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9dada26-4cff-40ac-8f5f-ab5478bba799 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:51.627075 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9dada26-4cff-40ac-8f5f-ab5478bba799 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:51.937776 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b9dada26-4cff-40ac-8f5f-ab5478bba799 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "POST /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326123 Sep 13 07:07:51.948797 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 463/889] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Sep 13 07:07:51 2022] POST /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:07:52.021215 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-27946b67-ba67-459e-b83f-ddd843f2d247 req-9034ccdf-36e0-4458-b85d-f86668866694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5618c6-5eed-4097-9add-4943c7251e95", "name": "network-vif-plugged", "status": "completed", "tag": "8123a51f-2109-4966-a1db-e715035c1e0e"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:07:52.035419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-27946b67-ba67-459e-b83f-ddd843f2d247 req-9034ccdf-36e0-4458-b85d-f86668866694 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:52.036221 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-27946b67-ba67-459e-b83f-ddd843f2d247 req-9034ccdf-36e0-4458-b85d-f86668866694 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:52.036654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-27946b67-ba67-459e-b83f-ddd843f2d247 req-9034ccdf-36e0-4458-b85d-f86668866694 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:52.049835 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-27946b67-ba67-459e-b83f-ddd843f2d247 req-9034ccdf-36e0-4458-b85d-f86668866694 service nova] Creating event network-vif-plugged:8123a51f-2109-4966-a1db-e715035c1e0e for instance ce5618c6-5eed-4097-9add-4943c7251e95 on hv-cinder-85694 Sep 13 07:07:52.055937 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-27946b67-ba67-459e-b83f-ddd843f2d247 req-9034ccdf-36e0-4458-b85d-f86668866694 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038041 Sep 13 07:07:52.059758 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 427/890] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:07:52.557651 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dafee142-af02-465a-a60e-b9918e4acd2c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:52.558418 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-dafee142-af02-465a-a60e-b9918e4acd2c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:52.564919 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dafee142-af02-465a-a60e-b9918e4acd2c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:52.565408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dafee142-af02-465a-a60e-b9918e4acd2c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:52.565890 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dafee142-af02-465a-a60e-b9918e4acd2c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:52.566690 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dafee142-af02-465a-a60e-b9918e4acd2c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:52.567144 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dafee142-af02-465a-a60e-b9918e4acd2c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:52.567604 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dafee142-af02-465a-a60e-b9918e4acd2c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:52.722760 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-dafee142-af02-465a-a60e-b9918e4acd2c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:52.733133 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dafee142-af02-465a-a60e-b9918e4acd2c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 200 len: 1265 microversion: 2.1 time: 0.180681 Sep 13 07:07:52.733987 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 464/891] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:52 2022] GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:53.763523 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-28b7bdfd-2454-49f4-b925-d2d599250577 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:53.764663 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-28b7bdfd-2454-49f4-b925-d2d599250577 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:53.774994 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28b7bdfd-2454-49f4-b925-d2d599250577 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:53.775471 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28b7bdfd-2454-49f4-b925-d2d599250577 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:53.775889 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28b7bdfd-2454-49f4-b925-d2d599250577 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:53.776573 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28b7bdfd-2454-49f4-b925-d2d599250577 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:53.777017 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28b7bdfd-2454-49f4-b925-d2d599250577 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:53.777441 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28b7bdfd-2454-49f4-b925-d2d599250577 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:53.915168 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-28b7bdfd-2454-49f4-b925-d2d599250577 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:53.923595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-28b7bdfd-2454-49f4-b925-d2d599250577 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 200 len: 1265 microversion: 2.1 time: 0.167871 Sep 13 07:07:53.924168 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 428/892] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:53 2022] GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:54.951945 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2a20a7c5-993c-4b9e-b40d-8a5f48e9fab6 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:54.952724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2a20a7c5-993c-4b9e-b40d-8a5f48e9fab6 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:54.961777 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2a20a7c5-993c-4b9e-b40d-8a5f48e9fab6 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:54.962410 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2a20a7c5-993c-4b9e-b40d-8a5f48e9fab6 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:54.963072 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2a20a7c5-993c-4b9e-b40d-8a5f48e9fab6 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:54.963950 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2a20a7c5-993c-4b9e-b40d-8a5f48e9fab6 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:54.964524 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2a20a7c5-993c-4b9e-b40d-8a5f48e9fab6 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:54.965056 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2a20a7c5-993c-4b9e-b40d-8a5f48e9fab6 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:55.111839 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2a20a7c5-993c-4b9e-b40d-8a5f48e9fab6 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:55.120368 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2a20a7c5-993c-4b9e-b40d-8a5f48e9fab6 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 200 len: 1453 microversion: 2.1 time: 0.173558 Sep 13 07:07:55.120931 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 465/893] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:54 2022] GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:07:55.142814 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-507253a9-5b29-4016-af11-ce611f47c07a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:55.143402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-507253a9-5b29-4016-af11-ce611f47c07a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:55.149975 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-507253a9-5b29-4016-af11-ce611f47c07a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:55.150494 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-507253a9-5b29-4016-af11-ce611f47c07a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:55.150919 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-507253a9-5b29-4016-af11-ce611f47c07a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:55.151606 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-507253a9-5b29-4016-af11-ce611f47c07a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:55.152035 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-507253a9-5b29-4016-af11-ce611f47c07a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:55.152447 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-507253a9-5b29-4016-af11-ce611f47c07a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:55.283451 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-507253a9-5b29-4016-af11-ce611f47c07a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:55.291556 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-507253a9-5b29-4016-af11-ce611f47c07a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 200 len: 1453 microversion: 2.1 time: 0.152882 Sep 13 07:07:55.292133 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 429/894] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:55 2022] GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:07:57.245966 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-8f864f1d-9db5-4077-a0a6-b18d5d0fa390 req-30da35f1-3310-4f7b-b8a5-d226df649e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce5618c6-5eed-4097-9add-4943c7251e95", "tag": "8123a51f-2109-4966-a1db-e715035c1e0e"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:07:57.255860 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8f864f1d-9db5-4077-a0a6-b18d5d0fa390 req-30da35f1-3310-4f7b-b8a5-d226df649e21 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:57.256329 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8f864f1d-9db5-4077-a0a6-b18d5d0fa390 req-30da35f1-3310-4f7b-b8a5-d226df649e21 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:57.256750 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8f864f1d-9db5-4077-a0a6-b18d5d0fa390 req-30da35f1-3310-4f7b-b8a5-d226df649e21 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:57.269681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-8f864f1d-9db5-4077-a0a6-b18d5d0fa390 req-30da35f1-3310-4f7b-b8a5-d226df649e21 service nova] Creating event network-changed:8123a51f-2109-4966-a1db-e715035c1e0e for instance ce5618c6-5eed-4097-9add-4943c7251e95 on hv-cinder-85694 Sep 13 07:07:57.276092 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-8f864f1d-9db5-4077-a0a6-b18d5d0fa390 req-30da35f1-3310-4f7b-b8a5-d226df649e21 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032947 Sep 13 07:07:57.276470 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 466/895] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:07:59.530501 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8fed7f78-502d-4244-8639-75612762db17 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:07:59.536909 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8fed7f78-502d-4244-8639-75612762db17 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:59.537442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8fed7f78-502d-4244-8639-75612762db17 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:59.537874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8fed7f78-502d-4244-8639-75612762db17 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:59.601741 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8fed7f78-502d-4244-8639-75612762db17 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Going to try to stop instance {{(pid=120695) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 07:07:59.650694 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8fed7f78-502d-4244-8639-75612762db17 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "POST /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7/action" status: 202 len: 0 microversion: 2.1 time: 0.123411 Sep 13 07:07:59.651255 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 430/896] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Sep 13 07:07:59 2022] POST /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:07:59.660267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-31f53fc9-4812-4c4b-b4f4-e5554b7f6a16 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:07:59.662769 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-31f53fc9-4812-4c4b-b4f4-e5554b7f6a16 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:07:59.671112 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-31f53fc9-4812-4c4b-b4f4-e5554b7f6a16 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:59.672828 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-31f53fc9-4812-4c4b-b4f4-e5554b7f6a16 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:59.673399 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-31f53fc9-4812-4c4b-b4f4-e5554b7f6a16 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:59.674847 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-31f53fc9-4812-4c4b-b4f4-e5554b7f6a16 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:07:59.675296 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-31f53fc9-4812-4c4b-b4f4-e5554b7f6a16 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:07:59.675714 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-31f53fc9-4812-4c4b-b4f4-e5554b7f6a16 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:07:59.823639 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-31f53fc9-4812-4c4b-b4f4-e5554b7f6a16 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:07:59.826447 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:59.836453 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-31f53fc9-4812-4c4b-b4f4-e5554b7f6a16 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1725 microversion: 2.1 time: 0.180273 Sep 13 07:07:59.838013 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 467/897] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:07:59 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:08:00.866819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1af6f72d-8747-4d70-8b67-562b34dfa8b4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:00.868132 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1af6f72d-8747-4d70-8b67-562b34dfa8b4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:00.871725 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:08:00.878006 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1af6f72d-8747-4d70-8b67-562b34dfa8b4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:00.878607 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1af6f72d-8747-4d70-8b67-562b34dfa8b4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:00.879090 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1af6f72d-8747-4d70-8b67-562b34dfa8b4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:00.879793 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1af6f72d-8747-4d70-8b67-562b34dfa8b4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:00.880237 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1af6f72d-8747-4d70-8b67-562b34dfa8b4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:00.880654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1af6f72d-8747-4d70-8b67-562b34dfa8b4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:01.034794 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1af6f72d-8747-4d70-8b67-562b34dfa8b4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:01.038207 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:08:01.043684 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1af6f72d-8747-4d70-8b67-562b34dfa8b4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1725 microversion: 2.1 time: 0.183758 Sep 13 07:08:01.044273 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 431/898] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:08:00 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:08:02.067127 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5197f401-e7d8-46f6-ba33-7610e59dadd3 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:02.067782 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5197f401-e7d8-46f6-ba33-7610e59dadd3 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:02.070324 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=71 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:08:02.077001 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5197f401-e7d8-46f6-ba33-7610e59dadd3 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:02.077516 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5197f401-e7d8-46f6-ba33-7610e59dadd3 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:02.077923 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5197f401-e7d8-46f6-ba33-7610e59dadd3 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:02.078629 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5197f401-e7d8-46f6-ba33-7610e59dadd3 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:02.079064 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5197f401-e7d8-46f6-ba33-7610e59dadd3 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:02.079479 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5197f401-e7d8-46f6-ba33-7610e59dadd3 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:02.218820 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5197f401-e7d8-46f6-ba33-7610e59dadd3 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:02.227209 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5197f401-e7d8-46f6-ba33-7610e59dadd3 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1725 microversion: 2.1 time: 0.164379 Sep 13 07:08:02.227766 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 468/899] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:08:02 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:08:03.255960 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6e2f73ae-0487-49cb-b8a5-08f20b363648 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:03.256948 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6e2f73ae-0487-49cb-b8a5-08f20b363648 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:03.266753 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e2f73ae-0487-49cb-b8a5-08f20b363648 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:03.267247 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e2f73ae-0487-49cb-b8a5-08f20b363648 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:03.267676 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e2f73ae-0487-49cb-b8a5-08f20b363648 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:03.269785 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e2f73ae-0487-49cb-b8a5-08f20b363648 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:03.269785 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e2f73ae-0487-49cb-b8a5-08f20b363648 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:03.269785 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e2f73ae-0487-49cb-b8a5-08f20b363648 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:03.401980 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6e2f73ae-0487-49cb-b8a5-08f20b363648 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:03.410619 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6e2f73ae-0487-49cb-b8a5-08f20b363648 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1725 microversion: 2.1 time: 0.161807 Sep 13 07:08:03.411199 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 432/900] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:08:03 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:08:04.434167 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e271710f-8f9b-4cd8-bd8f-c98b7026a728 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:04.435561 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e271710f-8f9b-4cd8-bd8f-c98b7026a728 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:04.442771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e271710f-8f9b-4cd8-bd8f-c98b7026a728 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:04.443260 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e271710f-8f9b-4cd8-bd8f-c98b7026a728 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:04.443692 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e271710f-8f9b-4cd8-bd8f-c98b7026a728 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:04.444393 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e271710f-8f9b-4cd8-bd8f-c98b7026a728 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:04.444847 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e271710f-8f9b-4cd8-bd8f-c98b7026a728 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:04.445270 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e271710f-8f9b-4cd8-bd8f-c98b7026a728 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:04.580205 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e271710f-8f9b-4cd8-bd8f-c98b7026a728 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:04.589235 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e271710f-8f9b-4cd8-bd8f-c98b7026a728 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1725 microversion: 2.1 time: 0.159419 Sep 13 07:08:04.589826 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 469/901] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:08:04 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:08:05.614106 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7c68b21d-25a1-4af6-bb6e-8acf7e69e666 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:05.615284 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7c68b21d-25a1-4af6-bb6e-8acf7e69e666 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:05.622857 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c68b21d-25a1-4af6-bb6e-8acf7e69e666 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:05.623340 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c68b21d-25a1-4af6-bb6e-8acf7e69e666 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:05.623854 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c68b21d-25a1-4af6-bb6e-8acf7e69e666 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:05.624546 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c68b21d-25a1-4af6-bb6e-8acf7e69e666 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:05.625017 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c68b21d-25a1-4af6-bb6e-8acf7e69e666 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:05.625439 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c68b21d-25a1-4af6-bb6e-8acf7e69e666 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:05.774147 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7c68b21d-25a1-4af6-bb6e-8acf7e69e666 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:05.787491 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7c68b21d-25a1-4af6-bb6e-8acf7e69e666 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1725 microversion: 2.1 time: 0.177962 Sep 13 07:08:05.788299 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 433/902] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:08:05 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:08:06.813717 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a0e6076f-15c9-4973-bf69-883de38cc965 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:06.814841 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a0e6076f-15c9-4973-bf69-883de38cc965 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:06.822360 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0e6076f-15c9-4973-bf69-883de38cc965 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:06.822844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0e6076f-15c9-4973-bf69-883de38cc965 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:06.823277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0e6076f-15c9-4973-bf69-883de38cc965 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:06.823974 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0e6076f-15c9-4973-bf69-883de38cc965 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:06.824426 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0e6076f-15c9-4973-bf69-883de38cc965 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:06.824846 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0e6076f-15c9-4973-bf69-883de38cc965 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:06.964814 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a0e6076f-15c9-4973-bf69-883de38cc965 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:06.973758 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a0e6076f-15c9-4973-bf69-883de38cc965 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1725 microversion: 2.1 time: 0.164196 Sep 13 07:08:06.974353 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 470/903] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:08:06 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:08:07.997835 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f5e4f6b2-597c-4a99-ab60-b727b10a80d2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:07.998465 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f5e4f6b2-597c-4a99-ab60-b727b10a80d2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:08.005331 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5e4f6b2-597c-4a99-ab60-b727b10a80d2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:08.005823 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5e4f6b2-597c-4a99-ab60-b727b10a80d2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:08.006273 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5e4f6b2-597c-4a99-ab60-b727b10a80d2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:08.006953 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5e4f6b2-597c-4a99-ab60-b727b10a80d2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:08.007398 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5e4f6b2-597c-4a99-ab60-b727b10a80d2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:08.007829 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5e4f6b2-597c-4a99-ab60-b727b10a80d2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:08.152484 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f5e4f6b2-597c-4a99-ab60-b727b10a80d2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:08.162049 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f5e4f6b2-597c-4a99-ab60-b727b10a80d2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1725 microversion: 2.1 time: 0.168257 Sep 13 07:08:08.162587 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 434/904] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:08:07 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:08:09.186714 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-be1194af-c48a-4f39-afe7-7339954ddc1b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:09.187336 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-be1194af-c48a-4f39-afe7-7339954ddc1b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:09.194479 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-be1194af-c48a-4f39-afe7-7339954ddc1b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:09.194965 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-be1194af-c48a-4f39-afe7-7339954ddc1b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:09.195398 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-be1194af-c48a-4f39-afe7-7339954ddc1b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:09.196100 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-be1194af-c48a-4f39-afe7-7339954ddc1b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:09.196572 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-be1194af-c48a-4f39-afe7-7339954ddc1b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:09.196991 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-be1194af-c48a-4f39-afe7-7339954ddc1b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:09.339561 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-be1194af-c48a-4f39-afe7-7339954ddc1b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:09.350047 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-be1194af-c48a-4f39-afe7-7339954ddc1b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1725 microversion: 2.1 time: 0.167245 Sep 13 07:08:09.351280 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 471/905] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:08:09 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:08:10.374497 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-cc59033f-984f-44ff-a34a-c705c33d167f tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:10.375163 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-cc59033f-984f-44ff-a34a-c705c33d167f tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:10.382559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cc59033f-984f-44ff-a34a-c705c33d167f tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:10.383694 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cc59033f-984f-44ff-a34a-c705c33d167f tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:10.384134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cc59033f-984f-44ff-a34a-c705c33d167f tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:10.384838 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cc59033f-984f-44ff-a34a-c705c33d167f tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:10.385291 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cc59033f-984f-44ff-a34a-c705c33d167f tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:10.385743 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cc59033f-984f-44ff-a34a-c705c33d167f tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:10.529820 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-cc59033f-984f-44ff-a34a-c705c33d167f tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:10.538579 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-cc59033f-984f-44ff-a34a-c705c33d167f tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1725 microversion: 2.1 time: 0.168155 Sep 13 07:08:10.539467 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 435/906] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:08:10 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:08:11.565049 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-66d83add-84a6-4e87-9f2d-3c6e9c37f782 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:11.565634 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-66d83add-84a6-4e87-9f2d-3c6e9c37f782 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:11.573052 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-66d83add-84a6-4e87-9f2d-3c6e9c37f782 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:11.573534 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-66d83add-84a6-4e87-9f2d-3c6e9c37f782 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:11.573957 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-66d83add-84a6-4e87-9f2d-3c6e9c37f782 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:11.574679 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-66d83add-84a6-4e87-9f2d-3c6e9c37f782 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:11.575126 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-66d83add-84a6-4e87-9f2d-3c6e9c37f782 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:11.575547 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-66d83add-84a6-4e87-9f2d-3c6e9c37f782 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:11.711719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-66d83add-84a6-4e87-9f2d-3c6e9c37f782 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:11.720028 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-66d83add-84a6-4e87-9f2d-3c6e9c37f782 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1725 microversion: 2.1 time: 0.158951 Sep 13 07:08:11.720584 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 472/907] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:08:11 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:08:12.751351 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-62ed4756-c278-4af6-8a62-7bb18fb8908a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:12.751958 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-62ed4756-c278-4af6-8a62-7bb18fb8908a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:12.758670 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-62ed4756-c278-4af6-8a62-7bb18fb8908a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:12.759210 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-62ed4756-c278-4af6-8a62-7bb18fb8908a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:12.759833 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-62ed4756-c278-4af6-8a62-7bb18fb8908a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:12.760810 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-62ed4756-c278-4af6-8a62-7bb18fb8908a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:12.761315 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-62ed4756-c278-4af6-8a62-7bb18fb8908a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:12.761735 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-62ed4756-c278-4af6-8a62-7bb18fb8908a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:12.974745 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-62ed4756-c278-4af6-8a62-7bb18fb8908a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:12.984288 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-62ed4756-c278-4af6-8a62-7bb18fb8908a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1725 microversion: 2.1 time: 0.236887 Sep 13 07:08:12.984886 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 436/908] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:08:12 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1725 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:08:14.008313 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-33b35cf0-e142-4783-8acc-8e24362e45a1 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:14.008963 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-33b35cf0-e142-4783-8acc-8e24362e45a1 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:14.016244 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33b35cf0-e142-4783-8acc-8e24362e45a1 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:14.016908 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33b35cf0-e142-4783-8acc-8e24362e45a1 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:14.017326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33b35cf0-e142-4783-8acc-8e24362e45a1 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:14.018018 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33b35cf0-e142-4783-8acc-8e24362e45a1 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:14.018500 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33b35cf0-e142-4783-8acc-8e24362e45a1 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:14.018916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33b35cf0-e142-4783-8acc-8e24362e45a1 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:14.163260 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-33b35cf0-e142-4783-8acc-8e24362e45a1 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:14.172887 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-33b35cf0-e142-4783-8acc-8e24362e45a1 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1725 microversion: 2.1 time: 0.168504 Sep 13 07:08:14.173449 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 473/909] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:08:14 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:08:15.196142 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6e4398dc-1009-4258-92d5-d1cfb1a15db6 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:15.196781 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6e4398dc-1009-4258-92d5-d1cfb1a15db6 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:15.204164 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e4398dc-1009-4258-92d5-d1cfb1a15db6 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:15.204650 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e4398dc-1009-4258-92d5-d1cfb1a15db6 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:15.205082 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e4398dc-1009-4258-92d5-d1cfb1a15db6 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:15.205776 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e4398dc-1009-4258-92d5-d1cfb1a15db6 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:15.206257 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e4398dc-1009-4258-92d5-d1cfb1a15db6 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:15.206680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e4398dc-1009-4258-92d5-d1cfb1a15db6 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:15.345298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6e4398dc-1009-4258-92d5-d1cfb1a15db6 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:15.359295 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6e4398dc-1009-4258-92d5-d1cfb1a15db6 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1702 microversion: 2.1 time: 0.166873 Sep 13 07:08:15.360128 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 437/910] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:08:15 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1702 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:08:15.385271 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c0d2f74b-f925-42ef-ab1a-993e9169f47a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:08:15.392257 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0d2f74b-f925-42ef-ab1a-993e9169f47a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:15.392740 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0d2f74b-f925-42ef-ab1a-993e9169f47a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:15.393173 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0d2f74b-f925-42ef-ab1a-993e9169f47a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:15.454202 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c0d2f74b-f925-42ef-ab1a-993e9169f47a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Going to try to start instance {{(pid=120696) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 07:08:15.499769 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c0d2f74b-f925-42ef-ab1a-993e9169f47a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "POST /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7/action" status: 202 len: 0 microversion: 2.1 time: 0.118487 Sep 13 07:08:15.500364 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 474/911] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Sep 13 07:08:15 2022] POST /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:08:15.509042 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9f952200-0d6a-4c10-bdf8-9dba510f9a1a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:15.510319 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9f952200-0d6a-4c10-bdf8-9dba510f9a1a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:15.516543 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9f952200-0d6a-4c10-bdf8-9dba510f9a1a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:15.517027 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9f952200-0d6a-4c10-bdf8-9dba510f9a1a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:15.517458 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9f952200-0d6a-4c10-bdf8-9dba510f9a1a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:15.518185 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9f952200-0d6a-4c10-bdf8-9dba510f9a1a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:15.518639 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9f952200-0d6a-4c10-bdf8-9dba510f9a1a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:15.519067 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9f952200-0d6a-4c10-bdf8-9dba510f9a1a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:15.666607 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9f952200-0d6a-4c10-bdf8-9dba510f9a1a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:15.675708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9f952200-0d6a-4c10-bdf8-9dba510f9a1a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1711 microversion: 2.1 time: 0.170756 Sep 13 07:08:15.676506 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 438/912] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:08:15 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1711 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:08:16.702809 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c1552593-0ad0-4baf-b0a0-e97290cef596 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:16.703476 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c1552593-0ad0-4baf-b0a0-e97290cef596 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:16.709728 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c1552593-0ad0-4baf-b0a0-e97290cef596 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:16.710249 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c1552593-0ad0-4baf-b0a0-e97290cef596 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:16.710750 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c1552593-0ad0-4baf-b0a0-e97290cef596 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:16.711438 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c1552593-0ad0-4baf-b0a0-e97290cef596 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:16.711871 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c1552593-0ad0-4baf-b0a0-e97290cef596 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:16.712349 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c1552593-0ad0-4baf-b0a0-e97290cef596 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:16.851502 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c1552593-0ad0-4baf-b0a0-e97290cef596 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:16.860041 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c1552593-0ad0-4baf-b0a0-e97290cef596 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1711 microversion: 2.1 time: 0.162386 Sep 13 07:08:16.860598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 475/913] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:08:16 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1711 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:08:17.883580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6fef20fc-ba1e-452f-b478-8bd06172257b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:17.884188 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6fef20fc-ba1e-452f-b478-8bd06172257b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:17.891910 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6fef20fc-ba1e-452f-b478-8bd06172257b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:17.892868 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6fef20fc-ba1e-452f-b478-8bd06172257b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:17.893311 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6fef20fc-ba1e-452f-b478-8bd06172257b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:17.894172 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6fef20fc-ba1e-452f-b478-8bd06172257b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:17.894625 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6fef20fc-ba1e-452f-b478-8bd06172257b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:17.895051 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6fef20fc-ba1e-452f-b478-8bd06172257b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:18.071124 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6fef20fc-ba1e-452f-b478-8bd06172257b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:18.080542 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6fef20fc-ba1e-452f-b478-8bd06172257b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1715 microversion: 2.1 time: 0.200904 Sep 13 07:08:18.081099 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 439/914] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:08:17 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1715 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:08:18.540903 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f66c9f23-a289-4a31-848c-d05f6fca2a11 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:18.543528 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f66c9f23-a289-4a31-848c-d05f6fca2a11 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:18.549836 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f66c9f23-a289-4a31-848c-d05f6fca2a11 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:18.550355 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f66c9f23-a289-4a31-848c-d05f6fca2a11 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:18.550790 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f66c9f23-a289-4a31-848c-d05f6fca2a11 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:18.551541 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f66c9f23-a289-4a31-848c-d05f6fca2a11 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:18.551996 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f66c9f23-a289-4a31-848c-d05f6fca2a11 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:18.552450 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f66c9f23-a289-4a31-848c-d05f6fca2a11 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:18.582613 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f66c9f23-a289-4a31-848c-d05f6fca2a11 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045748 Sep 13 07:08:18.583179 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 476/915] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Sep 13 07:08:18 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:08:18.806587 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f8bf222f-25bb-4340-b5db-3b71c3d03b71 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:18.807149 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f8bf222f-25bb-4340-b5db-3b71c3d03b71 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:18.815959 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f8bf222f-25bb-4340-b5db-3b71c3d03b71 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:18.816663 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f8bf222f-25bb-4340-b5db-3b71c3d03b71 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:18.817265 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f8bf222f-25bb-4340-b5db-3b71c3d03b71 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:18.818760 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f8bf222f-25bb-4340-b5db-3b71c3d03b71 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:18.819382 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f8bf222f-25bb-4340-b5db-3b71c3d03b71 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:18.819794 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f8bf222f-25bb-4340-b5db-3b71c3d03b71 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:18.847126 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f8bf222f-25bb-4340-b5db-3b71c3d03b71 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:08:18.935333 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f8bf222f-25bb-4340-b5db-3b71c3d03b71 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 204 len: 0 microversion: 2.20 time: 0.135130 Sep 13 07:08:18.939871 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 440/916] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Sep 13 07:08:18 2022] DELETE /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 07:08:18.945718 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-14b3a1cf-9f79-488c-99c3-dba83b19d1cc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:18.946389 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-14b3a1cf-9f79-488c-99c3-dba83b19d1cc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:18.953523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14b3a1cf-9f79-488c-99c3-dba83b19d1cc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:18.954002 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14b3a1cf-9f79-488c-99c3-dba83b19d1cc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:18.954454 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14b3a1cf-9f79-488c-99c3-dba83b19d1cc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:18.955165 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14b3a1cf-9f79-488c-99c3-dba83b19d1cc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:18.955614 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14b3a1cf-9f79-488c-99c3-dba83b19d1cc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:18.956030 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14b3a1cf-9f79-488c-99c3-dba83b19d1cc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:19.091996 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-14b3a1cf-9f79-488c-99c3-dba83b19d1cc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:19.103546 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-14b3a1cf-9f79-488c-99c3-dba83b19d1cc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:19.106511 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-14b3a1cf-9f79-488c-99c3-dba83b19d1cc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:19.108784 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-14b3a1cf-9f79-488c-99c3-dba83b19d1cc tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1724 microversion: 2.20 time: 0.167041 Sep 13 07:08:19.109565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 477/917] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:08:18 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:08:20.135221 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5f470f59-1df7-47ec-93e9-b7f008044ff1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:20.135814 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5f470f59-1df7-47ec-93e9-b7f008044ff1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:20.142989 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f470f59-1df7-47ec-93e9-b7f008044ff1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:20.143477 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f470f59-1df7-47ec-93e9-b7f008044ff1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:20.143920 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f470f59-1df7-47ec-93e9-b7f008044ff1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:20.144615 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f470f59-1df7-47ec-93e9-b7f008044ff1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:20.145069 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f470f59-1df7-47ec-93e9-b7f008044ff1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:20.145491 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f470f59-1df7-47ec-93e9-b7f008044ff1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:20.287918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5f470f59-1df7-47ec-93e9-b7f008044ff1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:20.297645 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5f470f59-1df7-47ec-93e9-b7f008044ff1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:20.299139 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5f470f59-1df7-47ec-93e9-b7f008044ff1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:20.300313 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5f470f59-1df7-47ec-93e9-b7f008044ff1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1724 microversion: 2.20 time: 0.169604 Sep 13 07:08:20.300872 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 441/918] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:08:20 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:08:21.329610 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f7f51043-ae70-42c6-a15f-095036b6029d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:21.330369 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f7f51043-ae70-42c6-a15f-095036b6029d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:21.341320 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f7f51043-ae70-42c6-a15f-095036b6029d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:21.341879 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f7f51043-ae70-42c6-a15f-095036b6029d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:21.342351 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f7f51043-ae70-42c6-a15f-095036b6029d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:21.343060 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f7f51043-ae70-42c6-a15f-095036b6029d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:21.343506 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f7f51043-ae70-42c6-a15f-095036b6029d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:21.343931 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f7f51043-ae70-42c6-a15f-095036b6029d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:21.579449 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f7f51043-ae70-42c6-a15f-095036b6029d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:21.588684 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f7f51043-ae70-42c6-a15f-095036b6029d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:21.590304 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f7f51043-ae70-42c6-a15f-095036b6029d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:21.591470 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f7f51043-ae70-42c6-a15f-095036b6029d tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1724 microversion: 2.20 time: 0.267171 Sep 13 07:08:21.593108 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 478/919] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:08:21 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:08:22.042658 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-5954d0d4-7acb-4b67-b26d-0e75ba0832db req-3a19f347-4785-4b75-b868-8b2da8b3d6fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1166e7-c092-4bde-b87c-cb8aaa1918da", "name": "network-vif-deleted", "tag": "dc830de4-1081-4c18-ada7-433d5588216c"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:08:22.053647 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-5954d0d4-7acb-4b67-b26d-0e75ba0832db req-3a19f347-4785-4b75-b868-8b2da8b3d6fc service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:22.054124 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-5954d0d4-7acb-4b67-b26d-0e75ba0832db req-3a19f347-4785-4b75-b868-8b2da8b3d6fc service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:22.054557 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-5954d0d4-7acb-4b67-b26d-0e75ba0832db req-3a19f347-4785-4b75-b868-8b2da8b3d6fc service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:22.067506 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-5954d0d4-7acb-4b67-b26d-0e75ba0832db req-3a19f347-4785-4b75-b868-8b2da8b3d6fc service nova] Creating event network-vif-deleted:dc830de4-1081-4c18-ada7-433d5588216c for instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da on hv-cinder-85694 Sep 13 07:08:22.072626 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-5954d0d4-7acb-4b67-b26d-0e75ba0832db req-3a19f347-4785-4b75-b868-8b2da8b3d6fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033926 Sep 13 07:08:22.073667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 442/920] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:08:22.619087 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b3aa8ef2-0257-4b93-8363-411cf6b580c5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:22.619790 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b3aa8ef2-0257-4b93-8363-411cf6b580c5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:22.626636 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3aa8ef2-0257-4b93-8363-411cf6b580c5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:22.627117 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3aa8ef2-0257-4b93-8363-411cf6b580c5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:22.627725 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3aa8ef2-0257-4b93-8363-411cf6b580c5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:22.628595 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3aa8ef2-0257-4b93-8363-411cf6b580c5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:22.629043 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3aa8ef2-0257-4b93-8363-411cf6b580c5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:22.629459 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3aa8ef2-0257-4b93-8363-411cf6b580c5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:22.661139 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3aa8ef2-0257-4b93-8363-411cf6b580c5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:22.661606 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3aa8ef2-0257-4b93-8363-411cf6b580c5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:22.662029 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3aa8ef2-0257-4b93-8363-411cf6b580c5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:22.662490 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-b3aa8ef2-0257-4b93-8363-411cf6b580c5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lazy-loading 'fault' on Instance uuid 8c1166e7-c092-4bde-b87c-cb8aaa1918da {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:08:22.712107 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b3aa8ef2-0257-4b93-8363-411cf6b580c5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:22.727264 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b3aa8ef2-0257-4b93-8363-411cf6b580c5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:22.728748 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b3aa8ef2-0257-4b93-8363-411cf6b580c5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf2dfd9bbe54b3085e9638caf8ad044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5ac5d4506943c48f4f7640d97f63c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:08:22.729941 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b3aa8ef2-0257-4b93-8363-411cf6b580c5 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 200 len: 1371 microversion: 2.20 time: 0.116705 Sep 13 07:08:22.730718 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 479/921] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:08:22 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 1371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:08:23.757070 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0b399024-2eb7-459a-a024-ee87756b9154 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:23.757784 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0b399024-2eb7-459a-a024-ee87756b9154 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:23.764527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0b399024-2eb7-459a-a024-ee87756b9154 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:23.764991 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0b399024-2eb7-459a-a024-ee87756b9154 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:23.765456 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0b399024-2eb7-459a-a024-ee87756b9154 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:23.766196 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0b399024-2eb7-459a-a024-ee87756b9154 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:23.766683 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0b399024-2eb7-459a-a024-ee87756b9154 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:23.767110 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0b399024-2eb7-459a-a024-ee87756b9154 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:23.781353 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-0b399024-2eb7-459a-a024-ee87756b9154 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] HTTP exception thrown: Instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da could not be found. Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0b399024-2eb7-459a-a024-ee87756b9154 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Request method failure captured: Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da HTTP/1.1 Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICq4nTd-aP038JiwuFg33jx8Zk7jhj6pQ2uHYezLvQNbNAU1rjnXAozUQp1dlj-QzL553aRRBtIslmCnTBnRyJYkjVEQHKpiU0KHLfSG_Dgxp2NA1zEAGqZ7MgkhWZhiD8vMrNeFUYk5I87ul6gDudadpSCN3KhR5aCN6kOHIYz1e88 Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: 5d5ac5d4506943c48f4f7640d97f63c5 Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2011100246 Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:08:23.783121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:08:23.784916 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5d5ac5d4506943c48f4f7640d97f63c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d5ac5d4506943c48f4f7640d97f63c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d5ac5d4506943c48f4f7640d97f63c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5d5ac5d4506943c48f4f7640d97f63c5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:08:23.784916 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2011100246 Sep 13 07:08:23.784916 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 5d5ac5d4506943c48f4f7640d97f63c5 Sep 13 07:08:23.784916 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2011100246 Sep 13 07:08:23.784916 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeShelveTestJSON-2011100246-project Sep 13 07:08:23.784916 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:08:23.784916 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:08:23.784916 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: ecf2dfd9bbe54b3085e9638caf8ad044 Sep 13 07:08:23.784916 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2011100246-project Sep 13 07:08:23.784916 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:08:23.784916 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da could not be found. Sep 13 07:08:23.784916 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': '8c1166e7-c092-4bde-b87c-cb8aaa1918da'} Sep 13 07:08:23.785914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:08:23.785914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:08:23.785914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:08:23.785914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:08:23.785914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:08:23.785914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:08:23.785914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:08:23.785914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:08:23.785914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:08:23.785914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:08:23.785914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da could not be found. Sep 13 07:08:23.785914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:08:23.785914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:08:23.785914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:08:23.785914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:08:23.785914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:08:23.785914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:08:23.785914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:08:23.785914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:08:23.785914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:08:23.787559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:08:23.787559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:08:23.787559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:08:23.787559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:08:23.787559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:08:23.787559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:08:23.787559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:08:23.787559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da could not be found. Sep 13 07:08:23.787559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:08:23.787559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:08:23.787559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:08:23.787559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:08:23.787559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:08:23.787559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:08:23.787559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:08:23.787559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:08:23.787559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da could not be found. Sep 13 07:08:23.787559 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:08:23.788991 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0b399024-2eb7-459a-a024-ee87756b9154 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Returning 404 to user: Instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:08:23.788991 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0b399024-2eb7-459a-a024-ee87756b9154 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 404 len: 111 microversion: 2.20 time: 0.032341 Sep 13 07:08:23.788991 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 443/922] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:08:23 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 07:08:23.794857 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1e5ea306-c66f-4ce2-9fd7-dcc0b7b79bff tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '.version_select at 0x7f4c195c0700>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:23.818514 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1e5ea306-c66f-4ce2-9fd7-dcc0b7b79bff tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-710260180" status: 204 len: 0 microversion: 2.20 time: 0.027689 Sep 13 07:08:23.819123 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 480/923] 10.222.0.25 () {60 vars in 1259 bytes} [Tue Sep 13 07:08:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-710260180 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 07:08:25.654666 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-aeac05ba-50ae-45f7-8dd0-e71c6012a7fe tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:25.655245 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-aeac05ba-50ae-45f7-8dd0-e71c6012a7fe tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:25.662189 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aeac05ba-50ae-45f7-8dd0-e71c6012a7fe tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:25.662666 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aeac05ba-50ae-45f7-8dd0-e71c6012a7fe tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:25.663098 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aeac05ba-50ae-45f7-8dd0-e71c6012a7fe tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:25.663785 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aeac05ba-50ae-45f7-8dd0-e71c6012a7fe tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:25.664228 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aeac05ba-50ae-45f7-8dd0-e71c6012a7fe tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:25.664642 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aeac05ba-50ae-45f7-8dd0-e71c6012a7fe tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:25.678254 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-aeac05ba-50ae-45f7-8dd0-e71c6012a7fe tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] HTTP exception thrown: Instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da could not be found. Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-aeac05ba-50ae-45f7-8dd0-e71c6012a7fe tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Request method failure captured: Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: DELETE /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da HTTP/1.1 Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICq4nTd-aP038JiwuFg33jx8Zk7jhj6pQ2uHYezLvQNbNAU1rjnXAozUQp1dlj-QzL553aRRBtIslmCnTBnRyJYkjVEQHKpiU0KHLfSG_Dgxp2NA1zEAGqZ7MgkhWZhiD8vMrNeFUYk5I87ul6gDudadpSCN3KhR5aCN6kOHIYz1e88 Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: 5d5ac5d4506943c48f4f7640d97f63c5 Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2011100246 Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:08:25.679801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:08:25.681689 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5d5ac5d4506943c48f4f7640d97f63c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d5ac5d4506943c48f4f7640d97f63c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d5ac5d4506943c48f4f7640d97f63c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5d5ac5d4506943c48f4f7640d97f63c5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:08:25.681689 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2011100246 Sep 13 07:08:25.681689 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 5d5ac5d4506943c48f4f7640d97f63c5 Sep 13 07:08:25.681689 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2011100246 Sep 13 07:08:25.681689 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeShelveTestJSON-2011100246-project Sep 13 07:08:25.681689 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:08:25.681689 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:08:25.681689 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: ecf2dfd9bbe54b3085e9638caf8ad044 Sep 13 07:08:25.681689 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2011100246-project Sep 13 07:08:25.681689 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:08:25.681689 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da could not be found. Sep 13 07:08:25.681689 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': '8c1166e7-c092-4bde-b87c-cb8aaa1918da'} Sep 13 07:08:25.682515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:08:25.682515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:08:25.682515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:08:25.682515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:08:25.682515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:08:25.682515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:08:25.682515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:08:25.682515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:08:25.682515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:08:25.682515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:08:25.682515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da could not be found. Sep 13 07:08:25.682515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:08:25.682515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:08:25.682515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:08:25.682515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:08:25.682515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:08:25.682515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:08:25.682515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:08:25.682515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:08:25.682515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:08:25.683757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:08:25.683757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 07:08:25.683757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 07:08:25.683757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 07:08:25.683757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 07:08:25.683757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:08:25.683757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:08:25.683757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:08:25.683757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:08:25.683757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da could not be found. Sep 13 07:08:25.683757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:08:25.683757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:08:25.683757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:08:25.683757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:08:25.683757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:08:25.683757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:08:25.683757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:08:25.683757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:08:25.683757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da could not be found. Sep 13 07:08:25.683757 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:08:25.685059 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-aeac05ba-50ae-45f7-8dd0-e71c6012a7fe tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Returning 404 to user: Instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:08:25.685059 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-aeac05ba-50ae-45f7-8dd0-e71c6012a7fe tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 404 len: 111 microversion: 2.20 time: 0.030873 Sep 13 07:08:25.685059 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 444/924] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Sep 13 07:08:25 2022] DELETE /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 07:08:25.691556 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-68c22328-9c90-4e17-96a6-2504ae610fe1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:25.692162 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-68c22328-9c90-4e17-96a6-2504ae610fe1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 8c1166e7-c092-4bde-b87c-cb8aaa1918da] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:25.698887 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68c22328-9c90-4e17-96a6-2504ae610fe1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:25.699388 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68c22328-9c90-4e17-96a6-2504ae610fe1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:25.699814 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68c22328-9c90-4e17-96a6-2504ae610fe1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:25.700532 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68c22328-9c90-4e17-96a6-2504ae610fe1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:25.700976 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68c22328-9c90-4e17-96a6-2504ae610fe1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:25.701427 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68c22328-9c90-4e17-96a6-2504ae610fe1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:25.714492 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-68c22328-9c90-4e17-96a6-2504ae610fe1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] HTTP exception thrown: Instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da could not be found. Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-68c22328-9c90-4e17-96a6-2504ae610fe1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Request method failure captured: Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da HTTP/1.1 Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICq4nTd-aP038JiwuFg33jx8Zk7jhj6pQ2uHYezLvQNbNAU1rjnXAozUQp1dlj-QzL553aRRBtIslmCnTBnRyJYkjVEQHKpiU0KHLfSG_Dgxp2NA1zEAGqZ7MgkhWZhiD8vMrNeFUYk5I87ul6gDudadpSCN3KhR5aCN6kOHIYz1e88 Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 5d5ac5d4506943c48f4f7640d97f63c5 Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2011100246 Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:08:25.716146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:08:25.717849 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5d5ac5d4506943c48f4f7640d97f63c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d5ac5d4506943c48f4f7640d97f63c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d5ac5d4506943c48f4f7640d97f63c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5d5ac5d4506943c48f4f7640d97f63c5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:08:25.717849 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2011100246 Sep 13 07:08:25.717849 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 5d5ac5d4506943c48f4f7640d97f63c5 Sep 13 07:08:25.717849 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2011100246 Sep 13 07:08:25.717849 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeShelveTestJSON-2011100246-project Sep 13 07:08:25.717849 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:08:25.717849 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:08:25.717849 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: ecf2dfd9bbe54b3085e9638caf8ad044 Sep 13 07:08:25.717849 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2011100246-project Sep 13 07:08:25.717849 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:08:25.717849 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da could not be found. Sep 13 07:08:25.717849 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': '8c1166e7-c092-4bde-b87c-cb8aaa1918da'} Sep 13 07:08:25.718821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:08:25.718821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:08:25.718821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:08:25.718821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:08:25.718821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:08:25.718821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:08:25.718821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:08:25.718821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:08:25.718821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:08:25.718821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:08:25.718821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da could not be found. Sep 13 07:08:25.718821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:08:25.718821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:08:25.718821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:08:25.718821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:08:25.718821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:08:25.718821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:08:25.718821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:08:25.718821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:08:25.718821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:08:25.720034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:08:25.720034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:08:25.720034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:08:25.720034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:08:25.720034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:08:25.720034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:08:25.720034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:08:25.720034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da could not be found. Sep 13 07:08:25.720034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:08:25.720034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:08:25.720034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:08:25.720034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:08:25.720034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:08:25.720034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:08:25.720034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:08:25.720034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:08:25.720034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da could not be found. Sep 13 07:08:25.720034 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:08:25.721148 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-68c22328-9c90-4e17-96a6-2504ae610fe1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Returning 404 to user: Instance 8c1166e7-c092-4bde-b87c-cb8aaa1918da could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:08:25.721148 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-68c22328-9c90-4e17-96a6-2504ae610fe1 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da" status: 404 len: 111 microversion: 2.20 time: 0.030576 Sep 13 07:08:25.721148 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 481/925] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:08:25 2022] GET /compute/v2.1/servers/8c1166e7-c092-4bde-b87c-cb8aaa1918da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 07:08:26.872877 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7c938a1b-5fab-4937-8a71-dc2786428465 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:26.873410 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7c938a1b-5fab-4937-8a71-dc2786428465 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:26.879727 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c938a1b-5fab-4937-8a71-dc2786428465 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:26.880203 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c938a1b-5fab-4937-8a71-dc2786428465 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:26.880648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c938a1b-5fab-4937-8a71-dc2786428465 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:26.881351 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c938a1b-5fab-4937-8a71-dc2786428465 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:26.881821 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c938a1b-5fab-4937-8a71-dc2786428465 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:26.882262 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c938a1b-5fab-4937-8a71-dc2786428465 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:26.896124 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-7c938a1b-5fab-4937-8a71-dc2786428465 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] HTTP exception thrown: Instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad could not be found. Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7c938a1b-5fab-4937-8a71-dc2786428465 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Request method failure captured: Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: DELETE /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad HTTP/1.1 Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICq4nTd-aP038JiwuFg33jx8Zk7jhj6pQ2uHYezLvQNbNAU1rjnXAozUQp1dlj-QzL553aRRBtIslmCnTBnRyJYkjVEQHKpiU0KHLfSG_Dgxp2NA1zEAGqZ7MgkhWZhiD8vMrNeFUYk5I87ul6gDudadpSCN3KhR5aCN6kOHIYz1e88 Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: 5d5ac5d4506943c48f4f7640d97f63c5 Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2011100246 Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:08:26.897680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:08:26.899580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5d5ac5d4506943c48f4f7640d97f63c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d5ac5d4506943c48f4f7640d97f63c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d5ac5d4506943c48f4f7640d97f63c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5d5ac5d4506943c48f4f7640d97f63c5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:08:26.899580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2011100246 Sep 13 07:08:26.899580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 5d5ac5d4506943c48f4f7640d97f63c5 Sep 13 07:08:26.899580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2011100246 Sep 13 07:08:26.899580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeShelveTestJSON-2011100246-project Sep 13 07:08:26.899580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:08:26.899580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:08:26.899580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: ecf2dfd9bbe54b3085e9638caf8ad044 Sep 13 07:08:26.899580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2011100246-project Sep 13 07:08:26.899580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:08:26.899580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad could not be found. Sep 13 07:08:26.899580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': '5d57882a-892f-4b45-a8ec-7b6f4b21b0ad'} Sep 13 07:08:26.900933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:08:26.900933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:08:26.900933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:08:26.900933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:08:26.900933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:08:26.900933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:08:26.900933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:08:26.900933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:08:26.900933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:08:26.900933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:08:26.900933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad could not be found. Sep 13 07:08:26.900933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:08:26.900933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:08:26.900933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:08:26.900933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:08:26.900933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:08:26.900933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:08:26.900933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:08:26.900933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:08:26.900933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:08:26.902918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:08:26.902918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 07:08:26.902918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 07:08:26.902918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 07:08:26.902918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 07:08:26.902918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:08:26.902918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:08:26.902918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:08:26.902918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:08:26.902918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad could not be found. Sep 13 07:08:26.902918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:08:26.902918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:08:26.902918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:08:26.902918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:08:26.902918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:08:26.902918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:08:26.902918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:08:26.902918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:08:26.902918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad could not be found. Sep 13 07:08:26.902918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:08:26.907158 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7c938a1b-5fab-4937-8a71-dc2786428465 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Returning 404 to user: Instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:08:26.907158 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7c938a1b-5fab-4937-8a71-dc2786428465 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 404 len: 111 microversion: 2.20 time: 0.030426 Sep 13 07:08:26.907158 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 445/926] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Sep 13 07:08:26 2022] DELETE /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 07:08:26.908079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-efd4c81b-59b7-4ff7-a725-8ddcbeb6f4c4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:08:26.908710 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-efd4c81b-59b7-4ff7-a725-8ddcbeb6f4c4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] [instance: 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:08:26.915775 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-efd4c81b-59b7-4ff7-a725-8ddcbeb6f4c4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:26.916265 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-efd4c81b-59b7-4ff7-a725-8ddcbeb6f4c4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:26.916698 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-efd4c81b-59b7-4ff7-a725-8ddcbeb6f4c4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:26.917407 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-efd4c81b-59b7-4ff7-a725-8ddcbeb6f4c4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:08:26.917885 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-efd4c81b-59b7-4ff7-a725-8ddcbeb6f4c4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:08:26.918339 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-efd4c81b-59b7-4ff7-a725-8ddcbeb6f4c4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:08:26.932399 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-efd4c81b-59b7-4ff7-a725-8ddcbeb6f4c4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] HTTP exception thrown: Instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad could not be found. Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-efd4c81b-59b7-4ff7-a725-8ddcbeb6f4c4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Request method failure captured: Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad HTTP/1.1 Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICq4nTd-aP038JiwuFg33jx8Zk7jhj6pQ2uHYezLvQNbNAU1rjnXAozUQp1dlj-QzL553aRRBtIslmCnTBnRyJYkjVEQHKpiU0KHLfSG_Dgxp2NA1zEAGqZ7MgkhWZhiD8vMrNeFUYk5I87ul6gDudadpSCN3KhR5aCN6kOHIYz1e88 Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 5d5ac5d4506943c48f4f7640d97f63c5 Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2011100246 Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:08:26.933943 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:08:26.935644 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5d5ac5d4506943c48f4f7640d97f63c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d5ac5d4506943c48f4f7640d97f63c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d5ac5d4506943c48f4f7640d97f63c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5d5ac5d4506943c48f4f7640d97f63c5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:08:26.935644 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2011100246 Sep 13 07:08:26.935644 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 5d5ac5d4506943c48f4f7640d97f63c5 Sep 13 07:08:26.935644 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2011100246 Sep 13 07:08:26.935644 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeShelveTestJSON-2011100246-project Sep 13 07:08:26.935644 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:08:26.935644 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:08:26.935644 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: ecf2dfd9bbe54b3085e9638caf8ad044 Sep 13 07:08:26.935644 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2011100246-project Sep 13 07:08:26.935644 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:08:26.935644 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad could not be found. Sep 13 07:08:26.935644 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': '5d57882a-892f-4b45-a8ec-7b6f4b21b0ad'} Sep 13 07:08:26.936598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:08:26.936598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:08:26.936598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:08:26.936598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:08:26.936598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:08:26.936598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:08:26.936598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:08:26.936598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:08:26.936598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:08:26.936598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:08:26.936598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad could not be found. Sep 13 07:08:26.936598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:08:26.936598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:08:26.936598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:08:26.936598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:08:26.936598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:08:26.936598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:08:26.936598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:08:26.936598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:08:26.936598 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:08:26.938122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:08:26.938122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:08:26.938122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:08:26.938122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:08:26.938122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:08:26.938122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:08:26.938122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:08:26.938122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad could not be found. Sep 13 07:08:26.938122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:08:26.938122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:08:26.938122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:08:26.938122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:08:26.938122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:08:26.938122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:08:26.938122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:08:26.938122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:08:26.938122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad could not be found. Sep 13 07:08:26.938122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:08:26.939551 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-efd4c81b-59b7-4ff7-a725-8ddcbeb6f4c4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] Returning 404 to user: Instance 5d57882a-892f-4b45-a8ec-7b6f4b21b0ad could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:08:26.939551 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-efd4c81b-59b7-4ff7-a725-8ddcbeb6f4c4 tempest-AttachVolumeShelveTestJSON-2011100246 tempest-AttachVolumeShelveTestJSON-2011100246-project] 10.222.0.25 "GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad" status: 404 len: 111 microversion: 2.20 time: 0.031466 Sep 13 07:08:26.939551 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 482/927] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Sep 13 07:08:26 2022] GET /compute/v2.1/servers/5d57882a-892f-4b45-a8ec-7b6f4b21b0ad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 13 07:09:12.885835 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b88e9d36-3153-4427-981b-8875d6138627 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:12.886509 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b88e9d36-3153-4427-981b-8875d6138627 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:12.888504 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:09:12.889151 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:09:12.895299 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b88e9d36-3153-4427-981b-8875d6138627 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:12.895814 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b88e9d36-3153-4427-981b-8875d6138627 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:12.896243 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b88e9d36-3153-4427-981b-8875d6138627 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:12.896936 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b88e9d36-3153-4427-981b-8875d6138627 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:12.897436 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b88e9d36-3153-4427-981b-8875d6138627 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:12.897852 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b88e9d36-3153-4427-981b-8875d6138627 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:12.960997 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-25bc4b52-b50c-46d1-bca3-ef0921eb8105 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:12.961569 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-25bc4b52-b50c-46d1-bca3-ef0921eb8105 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:12.963949 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:09:12.964573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:09:12.970478 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25bc4b52-b50c-46d1-bca3-ef0921eb8105 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:12.970972 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25bc4b52-b50c-46d1-bca3-ef0921eb8105 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:12.971408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25bc4b52-b50c-46d1-bca3-ef0921eb8105 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:12.972109 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25bc4b52-b50c-46d1-bca3-ef0921eb8105 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:12.972558 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25bc4b52-b50c-46d1-bca3-ef0921eb8105 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:12.972979 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25bc4b52-b50c-46d1-bca3-ef0921eb8105 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:12.992148 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-b88e9d36-3153-4427-981b-8875d6138627 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lazy-loading 'services' on Instance uuid 14d8a213-41c7-497e-a6a1-82dea1b238d7 {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:09:13.003524 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-25bc4b52-b50c-46d1-bca3-ef0921eb8105 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:09:13.094722 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b88e9d36-3153-4427-981b-8875d6138627 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "DELETE /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7/os-volume_attachments/eea7e092-9238-469f-b26c-2c0142311e3e" status: 202 len: 0 microversion: 2.1 time: 0.212919 Sep 13 07:09:13.095527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 446/928] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Sep 13 07:09:12 2022] DELETE /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7/os-volume_attachments/eea7e092-9238-469f-b26c-2c0142311e3e => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:09:13.119698 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-25bc4b52-b50c-46d1-bca3-ef0921eb8105 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 204 len: 0 microversion: 2.1 time: 0.162589 Sep 13 07:09:13.121638 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 483/929] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:09:12 2022] DELETE /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:09:13.140983 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f87056c7-1ebd-4ae5-a5b3-2f8b84a4aad8 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:13.141948 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f87056c7-1ebd-4ae5-a5b3-2f8b84a4aad8 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:13.151823 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f87056c7-1ebd-4ae5-a5b3-2f8b84a4aad8 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:13.152035 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-87b5212d-33f8-4af9-a92a-6a5c2d6f5a8a req-1940a29a-4635-45d4-8472-b807f8bdeb3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d695cc83-d3c5-44c9-af4a-2f0e67a96adf", "tag": "a7477596-3b59-40f9-9676-9d56b3b3aba4"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:09:13.152852 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f87056c7-1ebd-4ae5-a5b3-2f8b84a4aad8 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:13.153511 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f87056c7-1ebd-4ae5-a5b3-2f8b84a4aad8 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:13.154502 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f87056c7-1ebd-4ae5-a5b3-2f8b84a4aad8 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:13.155173 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f87056c7-1ebd-4ae5-a5b3-2f8b84a4aad8 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:13.155954 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f87056c7-1ebd-4ae5-a5b3-2f8b84a4aad8 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:13.174588 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-87b5212d-33f8-4af9-a92a-6a5c2d6f5a8a req-1940a29a-4635-45d4-8472-b807f8bdeb3a service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:13.175105 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-87b5212d-33f8-4af9-a92a-6a5c2d6f5a8a req-1940a29a-4635-45d4-8472-b807f8bdeb3a service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:13.175732 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-87b5212d-33f8-4af9-a92a-6a5c2d6f5a8a req-1940a29a-4635-45d4-8472-b807f8bdeb3a service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:13.212541 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-87b5212d-33f8-4af9-a92a-6a5c2d6f5a8a req-1940a29a-4635-45d4-8472-b807f8bdeb3a service nova] Creating event network-changed:a7477596-3b59-40f9-9676-9d56b3b3aba4 for instance d695cc83-d3c5-44c9-af4a-2f0e67a96adf on hv-cinder-85694 Sep 13 07:09:13.218222 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-87b5212d-33f8-4af9-a92a-6a5c2d6f5a8a req-1940a29a-4635-45d4-8472-b807f8bdeb3a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121159 Sep 13 07:09:13.219011 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 447/930] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:09:13.320539 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f87056c7-1ebd-4ae5-a5b3-2f8b84a4aad8 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:13.331227 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f87056c7-1ebd-4ae5-a5b3-2f8b84a4aad8 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1569 microversion: 2.1 time: 0.196366 Sep 13 07:09:13.332182 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 484/931] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:13 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1569 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:14.357277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-10f10ce3-f811-4310-adf7-0bb1f316afd4 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:14.358453 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-10f10ce3-f811-4310-adf7-0bb1f316afd4 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:14.366152 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-10f10ce3-f811-4310-adf7-0bb1f316afd4 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:14.366668 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-10f10ce3-f811-4310-adf7-0bb1f316afd4 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:14.367103 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-10f10ce3-f811-4310-adf7-0bb1f316afd4 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:14.367799 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-10f10ce3-f811-4310-adf7-0bb1f316afd4 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:14.368248 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-10f10ce3-f811-4310-adf7-0bb1f316afd4 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:14.372924 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-10f10ce3-f811-4310-adf7-0bb1f316afd4 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:14.517303 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-10f10ce3-f811-4310-adf7-0bb1f316afd4 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:14.530903 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-10f10ce3-f811-4310-adf7-0bb1f316afd4 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1569 microversion: 2.1 time: 0.179055 Sep 13 07:09:14.531635 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 448/932] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:14 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:15.556730 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-68bac526-8394-4a6a-98e1-c1cf6ea610d7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:15.557318 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-68bac526-8394-4a6a-98e1-c1cf6ea610d7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:15.564593 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68bac526-8394-4a6a-98e1-c1cf6ea610d7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:15.565076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68bac526-8394-4a6a-98e1-c1cf6ea610d7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:15.565487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68bac526-8394-4a6a-98e1-c1cf6ea610d7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:15.566211 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68bac526-8394-4a6a-98e1-c1cf6ea610d7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:15.566663 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68bac526-8394-4a6a-98e1-c1cf6ea610d7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:15.567072 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68bac526-8394-4a6a-98e1-c1cf6ea610d7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:15.716182 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-68bac526-8394-4a6a-98e1-c1cf6ea610d7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:15.724115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-68bac526-8394-4a6a-98e1-c1cf6ea610d7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1569 microversion: 2.1 time: 0.172428 Sep 13 07:09:15.724885 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 485/933] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:15 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:16.748304 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3f8af41a-85e8-4897-b9bb-903aaf0873ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:16.749038 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3f8af41a-85e8-4897-b9bb-903aaf0873ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:16.755794 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f8af41a-85e8-4897-b9bb-903aaf0873ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:16.756339 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f8af41a-85e8-4897-b9bb-903aaf0873ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:16.757847 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f8af41a-85e8-4897-b9bb-903aaf0873ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:16.758811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f8af41a-85e8-4897-b9bb-903aaf0873ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:16.759599 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f8af41a-85e8-4897-b9bb-903aaf0873ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:16.760192 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f8af41a-85e8-4897-b9bb-903aaf0873ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:16.919101 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3f8af41a-85e8-4897-b9bb-903aaf0873ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:16.927317 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3f8af41a-85e8-4897-b9bb-903aaf0873ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1569 microversion: 2.1 time: 0.183188 Sep 13 07:09:16.927821 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 449/934] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:16 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:09:17.954301 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c7c06791-b748-42ae-bfc0-041cef9cf808 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:17.962321 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c7c06791-b748-42ae-bfc0-041cef9cf808 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:17.971471 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c7c06791-b748-42ae-bfc0-041cef9cf808 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:17.972075 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c7c06791-b748-42ae-bfc0-041cef9cf808 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:17.972706 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c7c06791-b748-42ae-bfc0-041cef9cf808 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:17.973483 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c7c06791-b748-42ae-bfc0-041cef9cf808 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:17.974007 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c7c06791-b748-42ae-bfc0-041cef9cf808 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:17.978907 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c7c06791-b748-42ae-bfc0-041cef9cf808 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:18.383867 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c7c06791-b748-42ae-bfc0-041cef9cf808 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:18.392662 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c7c06791-b748-42ae-bfc0-041cef9cf808 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1569 microversion: 2.1 time: 0.445451 Sep 13 07:09:18.400577 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 486/935] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:17 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1569 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:18.591306 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-45b804f1-96e0-4845-9dd6-dc1e994a4351 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:09:18.640640 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-45b804f1-96e0-4845-9dd6-dc1e994a4351 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:18.641269 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-45b804f1-96e0-4845-9dd6-dc1e994a4351 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:18.641785 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-45b804f1-96e0-4845-9dd6-dc1e994a4351 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:18.684973 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-45b804f1-96e0-4845-9dd6-dc1e994a4351 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Going to try to stop instance {{(pid=120695) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 07:09:18.750442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-45b804f1-96e0-4845-9dd6-dc1e994a4351 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "POST /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7/action" status: 202 len: 0 microversion: 2.1 time: 0.164423 Sep 13 07:09:18.751057 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 450/936] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Sep 13 07:09:18 2022] POST /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:09:18.760014 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9429ecc0-2a7a-45aa-8232-070f4285c8c5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:18.761135 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9429ecc0-2a7a-45aa-8232-070f4285c8c5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:18.768325 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9429ecc0-2a7a-45aa-8232-070f4285c8c5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:18.768773 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9429ecc0-2a7a-45aa-8232-070f4285c8c5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:18.769447 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9429ecc0-2a7a-45aa-8232-070f4285c8c5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:18.770216 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9429ecc0-2a7a-45aa-8232-070f4285c8c5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:18.770856 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9429ecc0-2a7a-45aa-8232-070f4285c8c5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:18.771478 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9429ecc0-2a7a-45aa-8232-070f4285c8c5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:18.777859 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-645fc277-eac0-4272-917a-aaf0c8d1734b req-d9c242c8-9d50-4453-9c1b-62bb7443a46f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d695cc83-d3c5-44c9-af4a-2f0e67a96adf", "name": "network-vif-deleted", "tag": "a7477596-3b59-40f9-9676-9d56b3b3aba4"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:09:18.788624 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-645fc277-eac0-4272-917a-aaf0c8d1734b req-d9c242c8-9d50-4453-9c1b-62bb7443a46f service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:18.789105 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-645fc277-eac0-4272-917a-aaf0c8d1734b req-d9c242c8-9d50-4453-9c1b-62bb7443a46f service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:18.789533 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-645fc277-eac0-4272-917a-aaf0c8d1734b req-d9c242c8-9d50-4453-9c1b-62bb7443a46f service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:18.801352 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-645fc277-eac0-4272-917a-aaf0c8d1734b req-d9c242c8-9d50-4453-9c1b-62bb7443a46f service nova] Creating event network-vif-deleted:a7477596-3b59-40f9-9676-9d56b3b3aba4 for instance d695cc83-d3c5-44c9-af4a-2f0e67a96adf on hv-cinder-85694 Sep 13 07:09:18.807427 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-645fc277-eac0-4272-917a-aaf0c8d1734b req-d9c242c8-9d50-4453-9c1b-62bb7443a46f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035856 Sep 13 07:09:18.808302 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 451/937] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:09:18.920666 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9429ecc0-2a7a-45aa-8232-070f4285c8c5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:18.928787 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9429ecc0-2a7a-45aa-8232-070f4285c8c5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1679 microversion: 2.1 time: 0.173172 Sep 13 07:09:18.929513 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 487/938] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:18 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:19.416374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-fa984cfa-6cf2-4b92-90cd-8fa3da03c1ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:19.417140 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-fa984cfa-6cf2-4b92-90cd-8fa3da03c1ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:19.423516 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa984cfa-6cf2-4b92-90cd-8fa3da03c1ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:19.424000 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa984cfa-6cf2-4b92-90cd-8fa3da03c1ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:19.424425 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa984cfa-6cf2-4b92-90cd-8fa3da03c1ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:19.425165 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa984cfa-6cf2-4b92-90cd-8fa3da03c1ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:19.425641 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa984cfa-6cf2-4b92-90cd-8fa3da03c1ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:19.426056 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa984cfa-6cf2-4b92-90cd-8fa3da03c1ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:19.461827 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa984cfa-6cf2-4b92-90cd-8fa3da03c1ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:19.462347 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa984cfa-6cf2-4b92-90cd-8fa3da03c1ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:19.462773 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa984cfa-6cf2-4b92-90cd-8fa3da03c1ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:19.463207 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-fa984cfa-6cf2-4b92-90cd-8fa3da03c1ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lazy-loading 'fault' on Instance uuid d695cc83-d3c5-44c9-af4a-2f0e67a96adf {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:09:19.506665 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-fa984cfa-6cf2-4b92-90cd-8fa3da03c1ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04d90d3f1e04a00b2ace1893ce5ef71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e08bdf8d28f4a5093df2c5b26ccb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:19.515039 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-fa984cfa-6cf2-4b92-90cd-8fa3da03c1ec tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 200 len: 1225 microversion: 2.1 time: 0.103273 Sep 13 07:09:19.515802 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 452/939] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:19 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:19.956190 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-076f4305-80e8-4eb3-af12-66721af32e0b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:19.958251 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-076f4305-80e8-4eb3-af12-66721af32e0b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:19.969822 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-076f4305-80e8-4eb3-af12-66721af32e0b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:19.970769 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-076f4305-80e8-4eb3-af12-66721af32e0b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:19.971511 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-076f4305-80e8-4eb3-af12-66721af32e0b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:19.972669 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-076f4305-80e8-4eb3-af12-66721af32e0b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:19.973435 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-076f4305-80e8-4eb3-af12-66721af32e0b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:19.974203 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-076f4305-80e8-4eb3-af12-66721af32e0b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:20.267631 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-076f4305-80e8-4eb3-af12-66721af32e0b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:20.276990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-076f4305-80e8-4eb3-af12-66721af32e0b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1679 microversion: 2.1 time: 0.327828 Sep 13 07:09:20.286055 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 488/940] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:19 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1679 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:20.539930 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-938ab422-2b56-4056-a300-ab26ec3822ff tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:20.540542 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-938ab422-2b56-4056-a300-ab26ec3822ff tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] [instance: d695cc83-d3c5-44c9-af4a-2f0e67a96adf] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:20.547596 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-938ab422-2b56-4056-a300-ab26ec3822ff tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:20.548064 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-938ab422-2b56-4056-a300-ab26ec3822ff tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:20.548497 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-938ab422-2b56-4056-a300-ab26ec3822ff tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:20.549201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-938ab422-2b56-4056-a300-ab26ec3822ff tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:20.549646 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-938ab422-2b56-4056-a300-ab26ec3822ff tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:20.550066 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-938ab422-2b56-4056-a300-ab26ec3822ff tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:20.565256 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-938ab422-2b56-4056-a300-ab26ec3822ff tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] HTTP exception thrown: Instance d695cc83-d3c5-44c9-af4a-2f0e67a96adf could not be found. Sep 13 07:09:20.566901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-938ab422-2b56-4056-a300-ab26ec3822ff tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Request method failure captured: Sep 13 07:09:20.566901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf HTTP/1.1 Sep 13 07:09:20.566901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:09:20.566901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:09:20.566901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:09:20.566901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:09:20.566901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:09:20.566901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:09:20.566901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:09:20.566901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:09:20.566901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICtZO5Hhyn-pCAmMZFeniQ-PWoyIyRJbBv5PdOnnLWBMh_C5j9YXJz2ghMNihWP8NrGf55Fjkm5lDwiPIlqHoerPuHG8s542ygIc1upe7BEYrS_1koBdwZj05SiS067ZHZbhze_fDm2_H_4JqfeDDbbu8VRtkzEEFtgR1ewwgh6fgGQ Sep 13 07:09:20.566901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:09:20.566901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:09:20.566901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:09:20.566901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:09:20.566901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:09:20.566901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:09:20.566901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: 8e08bdf8d28f4a5093df2c5b26ccb9e6 Sep 13 07:09:20.566901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-TestShelveInstance-2126020596 Sep 13 07:09:20.566901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:09:20.566901 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:09:20.568907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8e08bdf8d28f4a5093df2c5b26ccb9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8e08bdf8d28f4a5093df2c5b26ccb9e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8e08bdf8d28f4a5093df2c5b26ccb9e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8e08bdf8d28f4a5093df2c5b26ccb9e6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:09:20.568907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-TestShelveInstance-2126020596 Sep 13 07:09:20.568907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 8e08bdf8d28f4a5093df2c5b26ccb9e6 Sep 13 07:09:20.568907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-TestShelveInstance-2126020596 Sep 13 07:09:20.568907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-TestShelveInstance-2126020596-project Sep 13 07:09:20.568907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:09:20.568907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:09:20.568907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: a04d90d3f1e04a00b2ace1893ce5ef71 Sep 13 07:09:20.568907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-TestShelveInstance-2126020596-project Sep 13 07:09:20.568907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:09:20.568907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Instance d695cc83-d3c5-44c9-af4a-2f0e67a96adf could not be found. Sep 13 07:09:20.568907 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': 'd695cc83-d3c5-44c9-af4a-2f0e67a96adf'} Sep 13 07:09:20.569939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:09:20.569939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:09:20.569939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:09:20.569939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:09:20.569939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:09:20.569939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:09:20.569939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:09:20.569939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:09:20.569939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:09:20.569939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:09:20.569939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d695cc83-d3c5-44c9-af4a-2f0e67a96adf could not be found. Sep 13 07:09:20.569939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:09:20.569939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:09:20.569939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:09:20.569939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:09:20.569939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:09:20.569939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:09:20.569939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:09:20.569939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:09:20.569939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:09:20.572898 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:09:20.572898 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:09:20.572898 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:09:20.572898 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:09:20.572898 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:09:20.572898 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:09:20.572898 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:09:20.572898 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d695cc83-d3c5-44c9-af4a-2f0e67a96adf could not be found. Sep 13 07:09:20.572898 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:09:20.572898 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:09:20.572898 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:09:20.572898 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:09:20.572898 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:09:20.572898 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:09:20.572898 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:09:20.572898 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:09:20.572898 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d695cc83-d3c5-44c9-af4a-2f0e67a96adf could not be found. Sep 13 07:09:20.572898 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:09:20.575572 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-938ab422-2b56-4056-a300-ab26ec3822ff tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Returning 404 to user: Instance d695cc83-d3c5-44c9-af4a-2f0e67a96adf could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:09:20.575572 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-938ab422-2b56-4056-a300-ab26ec3822ff tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf" status: 404 len: 111 microversion: 2.1 time: 0.033017 Sep 13 07:09:20.575572 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 453/941] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:20 2022] GET /compute/v2.1/servers/d695cc83-d3c5-44c9-af4a-2f0e67a96adf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:09:20.752609 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a44351ba-1cba-4ac5-9fcb-ac644aeaa6c7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] Calling method '.version_select at 0x7f4c19526e50>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:20.791509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a44351ba-1cba-4ac5-9fcb-ac644aeaa6c7 tempest-TestShelveInstance-2126020596 tempest-TestShelveInstance-2126020596-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1849819186" status: 202 len: 0 microversion: 2.1 time: 0.043754 Sep 13 07:09:20.794125 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 489/942] 10.222.0.25 () {58 vars in 1254 bytes} [Tue Sep 13 07:09:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1849819186 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:09:21.301213 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c4cfb788-d448-464d-8807-01730b6e6506 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:21.302128 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c4cfb788-d448-464d-8807-01730b6e6506 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:21.308997 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c4cfb788-d448-464d-8807-01730b6e6506 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:21.309481 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c4cfb788-d448-464d-8807-01730b6e6506 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:21.309924 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c4cfb788-d448-464d-8807-01730b6e6506 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:21.310637 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c4cfb788-d448-464d-8807-01730b6e6506 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:21.311098 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c4cfb788-d448-464d-8807-01730b6e6506 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:21.311516 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c4cfb788-d448-464d-8807-01730b6e6506 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:21.560351 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c4cfb788-d448-464d-8807-01730b6e6506 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:21.570022 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c4cfb788-d448-464d-8807-01730b6e6506 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1679 microversion: 2.1 time: 0.272519 Sep 13 07:09:21.570657 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 454/943] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:21 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1679 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:22.595153 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-84f4f151-bc06-4e6c-a2fc-08563df87fa9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:22.596375 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-84f4f151-bc06-4e6c-a2fc-08563df87fa9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:22.621627 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-84f4f151-bc06-4e6c-a2fc-08563df87fa9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:22.622531 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-84f4f151-bc06-4e6c-a2fc-08563df87fa9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:22.623208 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-84f4f151-bc06-4e6c-a2fc-08563df87fa9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:22.624962 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-84f4f151-bc06-4e6c-a2fc-08563df87fa9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:22.625947 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-84f4f151-bc06-4e6c-a2fc-08563df87fa9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:22.626740 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-84f4f151-bc06-4e6c-a2fc-08563df87fa9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:22.852719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-84f4f151-bc06-4e6c-a2fc-08563df87fa9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:22.861150 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-84f4f151-bc06-4e6c-a2fc-08563df87fa9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1679 microversion: 2.1 time: 0.272151 Sep 13 07:09:22.876599 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 490/944] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:22 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1679 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:23.889064 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d313d8b8-9cf2-47d9-ac3d-ddd3d1a028fd tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:23.890296 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d313d8b8-9cf2-47d9-ac3d-ddd3d1a028fd tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:23.897277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d313d8b8-9cf2-47d9-ac3d-ddd3d1a028fd tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:23.898022 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d313d8b8-9cf2-47d9-ac3d-ddd3d1a028fd tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:23.898667 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d313d8b8-9cf2-47d9-ac3d-ddd3d1a028fd tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:23.899576 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d313d8b8-9cf2-47d9-ac3d-ddd3d1a028fd tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:23.899996 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d313d8b8-9cf2-47d9-ac3d-ddd3d1a028fd tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:23.900590 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d313d8b8-9cf2-47d9-ac3d-ddd3d1a028fd tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:24.058981 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d313d8b8-9cf2-47d9-ac3d-ddd3d1a028fd tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:24.067824 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d313d8b8-9cf2-47d9-ac3d-ddd3d1a028fd tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1679 microversion: 2.1 time: 0.182616 Sep 13 07:09:24.069074 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 455/945] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:23 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:25.092756 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-caeedfdd-4c6d-4182-994d-714daaef5dfa tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:25.093365 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-caeedfdd-4c6d-4182-994d-714daaef5dfa tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:25.102158 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-caeedfdd-4c6d-4182-994d-714daaef5dfa tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:25.102876 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-caeedfdd-4c6d-4182-994d-714daaef5dfa tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:25.103486 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-caeedfdd-4c6d-4182-994d-714daaef5dfa tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:25.105040 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-caeedfdd-4c6d-4182-994d-714daaef5dfa tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:25.105496 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-caeedfdd-4c6d-4182-994d-714daaef5dfa tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:25.105914 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-caeedfdd-4c6d-4182-994d-714daaef5dfa tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:25.252379 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-caeedfdd-4c6d-4182-994d-714daaef5dfa tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:25.260983 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-caeedfdd-4c6d-4182-994d-714daaef5dfa tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1679 microversion: 2.1 time: 0.172136 Sep 13 07:09:25.261588 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 491/946] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:25 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:26.287943 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-79b2eba5-982e-4384-ad17-a2741b5f2ff9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:26.289586 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-79b2eba5-982e-4384-ad17-a2741b5f2ff9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:26.296522 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79b2eba5-982e-4384-ad17-a2741b5f2ff9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:26.297262 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79b2eba5-982e-4384-ad17-a2741b5f2ff9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:26.297700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79b2eba5-982e-4384-ad17-a2741b5f2ff9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:26.298442 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79b2eba5-982e-4384-ad17-a2741b5f2ff9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:26.298920 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79b2eba5-982e-4384-ad17-a2741b5f2ff9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:26.299681 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79b2eba5-982e-4384-ad17-a2741b5f2ff9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:26.439906 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-79b2eba5-982e-4384-ad17-a2741b5f2ff9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:26.449777 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-79b2eba5-982e-4384-ad17-a2741b5f2ff9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1679 microversion: 2.1 time: 0.165990 Sep 13 07:09:26.450826 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 456/947] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:26 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:27.473522 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d091cfb4-bc57-43e2-860f-5818f8beb566 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:27.475051 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d091cfb4-bc57-43e2-860f-5818f8beb566 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:27.486248 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d091cfb4-bc57-43e2-860f-5818f8beb566 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:27.487540 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d091cfb4-bc57-43e2-860f-5818f8beb566 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:27.488096 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d091cfb4-bc57-43e2-860f-5818f8beb566 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:27.489836 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d091cfb4-bc57-43e2-860f-5818f8beb566 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:27.491156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d091cfb4-bc57-43e2-860f-5818f8beb566 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:27.498260 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d091cfb4-bc57-43e2-860f-5818f8beb566 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:27.739288 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d091cfb4-bc57-43e2-860f-5818f8beb566 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:27.755110 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d091cfb4-bc57-43e2-860f-5818f8beb566 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1679 microversion: 2.1 time: 0.285709 Sep 13 07:09:27.755719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 492/948] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:27 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1679 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:28.780054 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1a53e5b8-96de-42eb-9833-9f6678698e15 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:28.780668 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1a53e5b8-96de-42eb-9833-9f6678698e15 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:28.787215 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1a53e5b8-96de-42eb-9833-9f6678698e15 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:28.788029 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1a53e5b8-96de-42eb-9833-9f6678698e15 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:28.788471 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1a53e5b8-96de-42eb-9833-9f6678698e15 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:28.789285 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1a53e5b8-96de-42eb-9833-9f6678698e15 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:28.789647 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1a53e5b8-96de-42eb-9833-9f6678698e15 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:28.790071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1a53e5b8-96de-42eb-9833-9f6678698e15 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:28.928533 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1a53e5b8-96de-42eb-9833-9f6678698e15 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:28.937634 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1a53e5b8-96de-42eb-9833-9f6678698e15 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1679 microversion: 2.1 time: 0.161413 Sep 13 07:09:28.938273 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 457/949] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:28 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:29.961188 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e06a4872-2f45-47fc-bb11-b7e337a72b18 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:29.961828 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e06a4872-2f45-47fc-bb11-b7e337a72b18 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:29.968435 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e06a4872-2f45-47fc-bb11-b7e337a72b18 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:29.968922 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e06a4872-2f45-47fc-bb11-b7e337a72b18 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:29.969354 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e06a4872-2f45-47fc-bb11-b7e337a72b18 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:29.970056 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e06a4872-2f45-47fc-bb11-b7e337a72b18 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:29.970560 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e06a4872-2f45-47fc-bb11-b7e337a72b18 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:29.970953 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e06a4872-2f45-47fc-bb11-b7e337a72b18 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:30.131183 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e06a4872-2f45-47fc-bb11-b7e337a72b18 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:30.140262 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e06a4872-2f45-47fc-bb11-b7e337a72b18 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1656 microversion: 2.1 time: 0.183306 Sep 13 07:09:30.141232 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 493/950] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:29 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1656 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:30.164319 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a3632141-6dc2-490c-a0a3-2dbe5e7b025c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:09:30.171731 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a3632141-6dc2-490c-a0a3-2dbe5e7b025c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:30.172224 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a3632141-6dc2-490c-a0a3-2dbe5e7b025c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:30.172629 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a3632141-6dc2-490c-a0a3-2dbe5e7b025c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:30.202986 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a3632141-6dc2-490c-a0a3-2dbe5e7b025c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Going to try to start instance {{(pid=120695) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 07:09:30.251478 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a3632141-6dc2-490c-a0a3-2dbe5e7b025c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "POST /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7/action" status: 202 len: 0 microversion: 2.1 time: 0.090819 Sep 13 07:09:30.252254 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 458/951] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Sep 13 07:09:30 2022] POST /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:09:30.261324 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5bad4e83-6405-47f0-afb6-8a45eb21c25d tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:30.261934 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5bad4e83-6405-47f0-afb6-8a45eb21c25d tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:30.269490 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5bad4e83-6405-47f0-afb6-8a45eb21c25d tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:30.270290 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5bad4e83-6405-47f0-afb6-8a45eb21c25d tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:30.270744 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5bad4e83-6405-47f0-afb6-8a45eb21c25d tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:30.272038 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5bad4e83-6405-47f0-afb6-8a45eb21c25d tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:30.272575 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5bad4e83-6405-47f0-afb6-8a45eb21c25d tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:30.272926 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5bad4e83-6405-47f0-afb6-8a45eb21c25d tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:30.452295 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5bad4e83-6405-47f0-afb6-8a45eb21c25d tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:30.460813 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5bad4e83-6405-47f0-afb6-8a45eb21c25d tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1665 microversion: 2.1 time: 0.203427 Sep 13 07:09:30.461621 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 494/952] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:30 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1665 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:31.486017 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e990f2a0-3df0-48ec-a3f4-401938d6fff2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:31.486777 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e990f2a0-3df0-48ec-a3f4-401938d6fff2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:31.493574 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e990f2a0-3df0-48ec-a3f4-401938d6fff2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:31.494063 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e990f2a0-3df0-48ec-a3f4-401938d6fff2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:31.494571 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e990f2a0-3df0-48ec-a3f4-401938d6fff2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:31.495278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e990f2a0-3df0-48ec-a3f4-401938d6fff2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:31.495736 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e990f2a0-3df0-48ec-a3f4-401938d6fff2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:31.496177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e990f2a0-3df0-48ec-a3f4-401938d6fff2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:31.661809 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e990f2a0-3df0-48ec-a3f4-401938d6fff2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:31.669572 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e990f2a0-3df0-48ec-a3f4-401938d6fff2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1665 microversion: 2.1 time: 0.189175 Sep 13 07:09:31.670169 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 459/953] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:31 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1665 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:09:32.695828 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bffc0034-781e-4f3b-a1fc-a0956edb0d98 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:32.696451 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bffc0034-781e-4f3b-a1fc-a0956edb0d98 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:32.703311 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bffc0034-781e-4f3b-a1fc-a0956edb0d98 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:32.703856 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bffc0034-781e-4f3b-a1fc-a0956edb0d98 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:32.704290 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bffc0034-781e-4f3b-a1fc-a0956edb0d98 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:32.704985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bffc0034-781e-4f3b-a1fc-a0956edb0d98 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:32.705447 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bffc0034-781e-4f3b-a1fc-a0956edb0d98 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:32.705865 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bffc0034-781e-4f3b-a1fc-a0956edb0d98 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:32.840323 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bffc0034-781e-4f3b-a1fc-a0956edb0d98 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:32.848218 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bffc0034-781e-4f3b-a1fc-a0956edb0d98 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1669 microversion: 2.1 time: 0.156600 Sep 13 07:09:32.848870 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 495/954] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:32 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:52.911896 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d0d66f57-d528-46cf-baea-debae72f866f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1059024891", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-206741384", "security_groups": [{"name": "tempest-secgroup-smoke-2025561016"}], "block_device_mapping_v2": [{"uuid": "d59a99f5-00ae-4871-94d7-24b7bc1491d3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3420c970-55c8-47dc-908b-5f5f431cebe9"}]}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:09:52.922778 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=30 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:09:52.923546 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:09:53.030874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-d0d66f57-d528-46cf-baea-debae72f866f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] validate_networks() for [('3420c970-55c8-47dc-908b-5f5f431cebe9', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:09:53.420892 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-d0d66f57-d528-46cf-baea-debae72f866f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:09:53.421403 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-d0d66f57-d528-46cf-baea-debae72f866f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:09:53.421984 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-d0d66f57-d528-46cf-baea-debae72f866f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:09:53.422456 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-d0d66f57-d528-46cf-baea-debae72f866f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:09:53.422846 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-d0d66f57-d528-46cf-baea-debae72f866f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:09:53.432832 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d0d66f57-d528-46cf-baea-debae72f866f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:53.433318 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d0d66f57-d528-46cf-baea-debae72f866f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:53.433744 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d0d66f57-d528-46cf-baea-debae72f866f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:53.434499 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d0d66f57-d528-46cf-baea-debae72f866f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:53.434944 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d0d66f57-d528-46cf-baea-debae72f866f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:53.435359 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d0d66f57-d528-46cf-baea-debae72f866f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:53.454334 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-d0d66f57-d528-46cf-baea-debae72f866f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Getting quotas for project 99bbe5cbd59f4feda4da45f2b14bd09b. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:09:53.459092 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-d0d66f57-d528-46cf-baea-debae72f866f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Getting quotas for user 67fa873d16414749bc478a59de3ec5b4 and project 99bbe5cbd59f4feda4da45f2b14bd09b. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:09:53.524353 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d0d66f57-d528-46cf-baea-debae72f866f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:09:53.526539 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d0d66f57-d528-46cf-baea-debae72f866f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d59a99f5-00ae-4871-94d7-24b7bc1491d3',volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:09:53.670681 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d0d66f57-d528-46cf-baea-debae72f866f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.762704 Sep 13 07:09:53.671329 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 460/955] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Sep 13 07:09:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 07:09:53.683174 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-21a603cb-52af-4992-b218-fdc89c203d6d tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:53.683791 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-21a603cb-52af-4992-b218-fdc89c203d6d tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:53.686847 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 07:09:53.686991 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Tue Sep 13 07:09:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 (ip 10.222.0.25) !!! Sep 13 07:09:53.688358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:09:53.689194 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:09:53.753080 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-21a603cb-52af-4992-b218-fdc89c203d6d tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:53.760137 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-21a603cb-52af-4992-b218-fdc89c203d6d tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 200 len: 1094 microversion: 2.1 time: 0.081188 Sep 13 07:09:53.761011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 496/956] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:53 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:54.784949 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6bf7ed5c-cad2-4688-9275-d5494c5ffcda tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:54.785529 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6bf7ed5c-cad2-4688-9275-d5494c5ffcda tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:54.792053 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6bf7ed5c-cad2-4688-9275-d5494c5ffcda tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:54.792543 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6bf7ed5c-cad2-4688-9275-d5494c5ffcda tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:54.792973 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6bf7ed5c-cad2-4688-9275-d5494c5ffcda tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:54.793672 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6bf7ed5c-cad2-4688-9275-d5494c5ffcda tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:54.794178 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6bf7ed5c-cad2-4688-9275-d5494c5ffcda tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:54.794685 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6bf7ed5c-cad2-4688-9275-d5494c5ffcda tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:54.867086 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6bf7ed5c-cad2-4688-9275-d5494c5ffcda tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:54.875167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6bf7ed5c-cad2-4688-9275-d5494c5ffcda tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 200 len: 1192 microversion: 2.1 time: 0.095935 Sep 13 07:09:54.875798 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 461/957] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:54 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 1192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:55.898233 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-141f4fd3-5f8b-4c54-817c-13217da5be5f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:55.898877 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-141f4fd3-5f8b-4c54-817c-13217da5be5f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:55.905458 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-141f4fd3-5f8b-4c54-817c-13217da5be5f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:55.905938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-141f4fd3-5f8b-4c54-817c-13217da5be5f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:55.906399 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-141f4fd3-5f8b-4c54-817c-13217da5be5f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:55.907084 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-141f4fd3-5f8b-4c54-817c-13217da5be5f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:55.907670 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-141f4fd3-5f8b-4c54-817c-13217da5be5f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:55.908833 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-141f4fd3-5f8b-4c54-817c-13217da5be5f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:56.116336 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-141f4fd3-5f8b-4c54-817c-13217da5be5f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:56.124480 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-141f4fd3-5f8b-4c54-817c-13217da5be5f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 200 len: 1266 microversion: 2.1 time: 0.230198 Sep 13 07:09:56.125115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 497/958] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:55 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:56.427269 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-d7b14cda-3383-4d61-bdb3-d685fe90a798 req-7ec417c5-8df5-4c0d-baa7-e32c271a06d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e083757-8d71-44e3-a1c7-adca051e9296", "tag": "7ac4efce-383d-4358-82c8-5099b44c4a3d"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:09:56.439495 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-d7b14cda-3383-4d61-bdb3-d685fe90a798 req-7ec417c5-8df5-4c0d-baa7-e32c271a06d1 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:56.439955 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-d7b14cda-3383-4d61-bdb3-d685fe90a798 req-7ec417c5-8df5-4c0d-baa7-e32c271a06d1 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:56.440361 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-d7b14cda-3383-4d61-bdb3-d685fe90a798 req-7ec417c5-8df5-4c0d-baa7-e32c271a06d1 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:56.454690 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-d7b14cda-3383-4d61-bdb3-d685fe90a798 req-7ec417c5-8df5-4c0d-baa7-e32c271a06d1 service nova] Creating event network-changed:7ac4efce-383d-4358-82c8-5099b44c4a3d for instance 7e083757-8d71-44e3-a1c7-adca051e9296 on hv-cinder-85694 Sep 13 07:09:56.459652 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-d7b14cda-3383-4d61-bdb3-d685fe90a798 req-7ec417c5-8df5-4c0d-baa7-e32c271a06d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037027 Sep 13 07:09:56.460237 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 462/959] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:09:57.152187 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1062e5cc-c831-489c-a2c7-6bc4d538a6f4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:57.153106 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1062e5cc-c831-489c-a2c7-6bc4d538a6f4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:57.163999 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1062e5cc-c831-489c-a2c7-6bc4d538a6f4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:57.164810 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1062e5cc-c831-489c-a2c7-6bc4d538a6f4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:57.165534 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1062e5cc-c831-489c-a2c7-6bc4d538a6f4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:57.166736 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1062e5cc-c831-489c-a2c7-6bc4d538a6f4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:57.167499 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1062e5cc-c831-489c-a2c7-6bc4d538a6f4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:57.168217 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1062e5cc-c831-489c-a2c7-6bc4d538a6f4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:57.389852 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1062e5cc-c831-489c-a2c7-6bc4d538a6f4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:57.398145 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1062e5cc-c831-489c-a2c7-6bc4d538a6f4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 200 len: 1266 microversion: 2.1 time: 0.252828 Sep 13 07:09:57.398741 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 498/960] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:57 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:58.422772 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f1541b5a-fa8c-49d8-b2ba-76feaf200c48 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:58.423476 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f1541b5a-fa8c-49d8-b2ba-76feaf200c48 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:58.429827 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f1541b5a-fa8c-49d8-b2ba-76feaf200c48 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:58.430350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f1541b5a-fa8c-49d8-b2ba-76feaf200c48 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:58.431125 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f1541b5a-fa8c-49d8-b2ba-76feaf200c48 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:58.431801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f1541b5a-fa8c-49d8-b2ba-76feaf200c48 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:58.432250 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f1541b5a-fa8c-49d8-b2ba-76feaf200c48 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:58.432670 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f1541b5a-fa8c-49d8-b2ba-76feaf200c48 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:58.588242 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f1541b5a-fa8c-49d8-b2ba-76feaf200c48 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:58.596476 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f1541b5a-fa8c-49d8-b2ba-76feaf200c48 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 200 len: 1266 microversion: 2.1 time: 0.178463 Sep 13 07:09:58.597052 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 463/961] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:58 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:09:59.621154 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3b052b4d-a240-413b-a83d-ad1298ecfad3 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:09:59.621762 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3b052b4d-a240-413b-a83d-ad1298ecfad3 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:09:59.628881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b052b4d-a240-413b-a83d-ad1298ecfad3 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:59.629360 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b052b4d-a240-413b-a83d-ad1298ecfad3 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:59.629793 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b052b4d-a240-413b-a83d-ad1298ecfad3 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:59.630523 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b052b4d-a240-413b-a83d-ad1298ecfad3 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:09:59.630978 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b052b4d-a240-413b-a83d-ad1298ecfad3 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:09:59.631396 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b052b4d-a240-413b-a83d-ad1298ecfad3 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:09:59.767760 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3b052b4d-a240-413b-a83d-ad1298ecfad3 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:09:59.779935 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3b052b4d-a240-413b-a83d-ad1298ecfad3 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 200 len: 1266 microversion: 2.1 time: 0.162617 Sep 13 07:09:59.780708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 499/962] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:09:59 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:00.809160 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d5d07790-184f-4a3a-8058-ed291fa7e0ff tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:00.810127 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d5d07790-184f-4a3a-8058-ed291fa7e0ff tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:00.821164 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5d07790-184f-4a3a-8058-ed291fa7e0ff tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:00.821955 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5d07790-184f-4a3a-8058-ed291fa7e0ff tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:00.822714 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5d07790-184f-4a3a-8058-ed291fa7e0ff tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:00.823848 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5d07790-184f-4a3a-8058-ed291fa7e0ff tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:00.824589 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5d07790-184f-4a3a-8058-ed291fa7e0ff tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:00.825268 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5d07790-184f-4a3a-8058-ed291fa7e0ff tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:00.965821 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d5d07790-184f-4a3a-8058-ed291fa7e0ff tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:00.977870 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d5d07790-184f-4a3a-8058-ed291fa7e0ff tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 200 len: 1266 microversion: 2.1 time: 0.175639 Sep 13 07:10:00.978669 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 464/963] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:00 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:02.003985 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-76a7af90-092b-41d5-a0af-cd2f75442000 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:02.004708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-76a7af90-092b-41d5-a0af-cd2f75442000 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:02.011611 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76a7af90-092b-41d5-a0af-cd2f75442000 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:02.012110 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76a7af90-092b-41d5-a0af-cd2f75442000 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:02.012543 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76a7af90-092b-41d5-a0af-cd2f75442000 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:02.013237 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76a7af90-092b-41d5-a0af-cd2f75442000 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:02.013697 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76a7af90-092b-41d5-a0af-cd2f75442000 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:02.014120 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76a7af90-092b-41d5-a0af-cd2f75442000 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:02.159851 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-76a7af90-092b-41d5-a0af-cd2f75442000 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:02.168544 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-76a7af90-092b-41d5-a0af-cd2f75442000 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 200 len: 1266 microversion: 2.1 time: 0.170869 Sep 13 07:10:02.169122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 500/964] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:01 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:03.204449 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c873e9b3-dc33-4cc0-8a6b-2eb3c5743a0f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:03.205468 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c873e9b3-dc33-4cc0-8a6b-2eb3c5743a0f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:03.213644 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c873e9b3-dc33-4cc0-8a6b-2eb3c5743a0f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:03.214137 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c873e9b3-dc33-4cc0-8a6b-2eb3c5743a0f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:03.214593 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c873e9b3-dc33-4cc0-8a6b-2eb3c5743a0f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:03.215288 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c873e9b3-dc33-4cc0-8a6b-2eb3c5743a0f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:03.215743 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c873e9b3-dc33-4cc0-8a6b-2eb3c5743a0f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:03.216161 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c873e9b3-dc33-4cc0-8a6b-2eb3c5743a0f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:03.358202 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c873e9b3-dc33-4cc0-8a6b-2eb3c5743a0f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:03.366302 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c873e9b3-dc33-4cc0-8a6b-2eb3c5743a0f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 200 len: 1266 microversion: 2.1 time: 0.168630 Sep 13 07:10:03.366877 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 465/965] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:03 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:04.391197 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-96fc5a4c-96aa-4dcf-801b-225685cf73c3 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:04.391812 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-96fc5a4c-96aa-4dcf-801b-225685cf73c3 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:04.394832 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:04.400733 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96fc5a4c-96aa-4dcf-801b-225685cf73c3 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:04.401215 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96fc5a4c-96aa-4dcf-801b-225685cf73c3 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:04.401643 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96fc5a4c-96aa-4dcf-801b-225685cf73c3 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:04.402329 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96fc5a4c-96aa-4dcf-801b-225685cf73c3 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:04.402813 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96fc5a4c-96aa-4dcf-801b-225685cf73c3 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:04.403232 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96fc5a4c-96aa-4dcf-801b-225685cf73c3 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:04.828114 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-96fc5a4c-96aa-4dcf-801b-225685cf73c3 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:04.836906 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-96fc5a4c-96aa-4dcf-801b-225685cf73c3 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 200 len: 1266 microversion: 2.1 time: 0.451530 Sep 13 07:10:04.837472 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 501/966] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:04 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 1266 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:05.452153 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0133a83b-6ff3-47dd-892d-9dfba8b86e88 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:05.455251 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0133a83b-6ff3-47dd-892d-9dfba8b86e88 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:05.457970 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:05.458828 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=6 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:05.465544 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0133a83b-6ff3-47dd-892d-9dfba8b86e88 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:05.466050 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0133a83b-6ff3-47dd-892d-9dfba8b86e88 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:05.466528 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0133a83b-6ff3-47dd-892d-9dfba8b86e88 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:05.467213 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0133a83b-6ff3-47dd-892d-9dfba8b86e88 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:05.467666 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0133a83b-6ff3-47dd-892d-9dfba8b86e88 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:05.468082 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0133a83b-6ff3-47dd-892d-9dfba8b86e88 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:05.497896 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0133a83b-6ff3-47dd-892d-9dfba8b86e88 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052428 Sep 13 07:10:05.498641 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 466/967] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Sep 13 07:10:05 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 07:10:05.571836 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-18c94ef1-c38e-4234-a845-7dd9c7a25676 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:05.572360 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-18c94ef1-c38e-4234-a845-7dd9c7a25676 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:05.579484 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18c94ef1-c38e-4234-a845-7dd9c7a25676 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:05.579968 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18c94ef1-c38e-4234-a845-7dd9c7a25676 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:05.580400 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18c94ef1-c38e-4234-a845-7dd9c7a25676 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:05.581091 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18c94ef1-c38e-4234-a845-7dd9c7a25676 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:05.581544 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18c94ef1-c38e-4234-a845-7dd9c7a25676 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:05.581964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18c94ef1-c38e-4234-a845-7dd9c7a25676 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:05.609238 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-18c94ef1-c38e-4234-a845-7dd9c7a25676 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:10:05.694328 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-18c94ef1-c38e-4234-a845-7dd9c7a25676 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "DELETE /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 204 len: 0 microversion: 2.1 time: 0.126329 Sep 13 07:10:05.695242 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 502/968] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:10:05 2022] DELETE /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:10:05.706966 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-31300c7e-f566-4c21-b9a7-7d4221308a11 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:05.707797 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-31300c7e-f566-4c21-b9a7-7d4221308a11 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:05.716347 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-31300c7e-f566-4c21-b9a7-7d4221308a11 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:05.716987 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-31300c7e-f566-4c21-b9a7-7d4221308a11 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:05.717561 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-31300c7e-f566-4c21-b9a7-7d4221308a11 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:05.718680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-31300c7e-f566-4c21-b9a7-7d4221308a11 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:05.719318 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-31300c7e-f566-4c21-b9a7-7d4221308a11 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:05.719808 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-31300c7e-f566-4c21-b9a7-7d4221308a11 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:05.850761 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-31300c7e-f566-4c21-b9a7-7d4221308a11 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:05.858858 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-31300c7e-f566-4c21-b9a7-7d4221308a11 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1675 microversion: 2.1 time: 0.158728 Sep 13 07:10:05.859402 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 467/969] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:05 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:05.861408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0678064d-741d-4665-acd1-ef1d6f7020a8 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:05.862156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0678064d-741d-4665-acd1-ef1d6f7020a8 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:05.868833 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0678064d-741d-4665-acd1-ef1d6f7020a8 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:05.869325 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0678064d-741d-4665-acd1-ef1d6f7020a8 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:05.869792 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0678064d-741d-4665-acd1-ef1d6f7020a8 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:05.870550 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0678064d-741d-4665-acd1-ef1d6f7020a8 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:05.871005 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0678064d-741d-4665-acd1-ef1d6f7020a8 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:05.871463 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0678064d-741d-4665-acd1-ef1d6f7020a8 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:06.009147 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0678064d-741d-4665-acd1-ef1d6f7020a8 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:06.017378 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0678064d-741d-4665-acd1-ef1d6f7020a8 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 200 len: 1266 microversion: 2.1 time: 0.161400 Sep 13 07:10:06.017951 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 503/970] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:05 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:06.883483 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5f6f647d-f7e0-4288-8efb-2c28a5d053dc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:06.884210 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5f6f647d-f7e0-4288-8efb-2c28a5d053dc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:06.891851 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f6f647d-f7e0-4288-8efb-2c28a5d053dc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:06.892379 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f6f647d-f7e0-4288-8efb-2c28a5d053dc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:06.892861 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f6f647d-f7e0-4288-8efb-2c28a5d053dc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:06.893625 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f6f647d-f7e0-4288-8efb-2c28a5d053dc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:06.894120 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f6f647d-f7e0-4288-8efb-2c28a5d053dc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:06.894632 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f6f647d-f7e0-4288-8efb-2c28a5d053dc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:07.026128 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5f6f647d-f7e0-4288-8efb-2c28a5d053dc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:07.034033 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5f6f647d-f7e0-4288-8efb-2c28a5d053dc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1675 microversion: 2.1 time: 0.154969 Sep 13 07:10:07.034638 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 468/971] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:06 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:07.042219 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-057e267f-ee54-4210-acf6-884e2c56c497 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:07.042953 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-057e267f-ee54-4210-acf6-884e2c56c497 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:07.051001 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-057e267f-ee54-4210-acf6-884e2c56c497 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:07.051512 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-057e267f-ee54-4210-acf6-884e2c56c497 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:07.051952 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-057e267f-ee54-4210-acf6-884e2c56c497 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:07.052736 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-057e267f-ee54-4210-acf6-884e2c56c497 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:07.053193 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-057e267f-ee54-4210-acf6-884e2c56c497 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:07.053619 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-057e267f-ee54-4210-acf6-884e2c56c497 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:07.191248 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-057e267f-ee54-4210-acf6-884e2c56c497 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:07.199283 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-057e267f-ee54-4210-acf6-884e2c56c497 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 200 len: 1266 microversion: 2.1 time: 0.161687 Sep 13 07:10:07.199858 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 504/972] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:07 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:08.057497 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8271cb33-a1c5-4f0f-8d88-a98a50b8889c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:08.058173 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8271cb33-a1c5-4f0f-8d88-a98a50b8889c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:08.065008 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8271cb33-a1c5-4f0f-8d88-a98a50b8889c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:08.065470 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8271cb33-a1c5-4f0f-8d88-a98a50b8889c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:08.065932 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8271cb33-a1c5-4f0f-8d88-a98a50b8889c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:08.066664 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8271cb33-a1c5-4f0f-8d88-a98a50b8889c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:08.067118 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8271cb33-a1c5-4f0f-8d88-a98a50b8889c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:08.067538 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8271cb33-a1c5-4f0f-8d88-a98a50b8889c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:08.222278 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-29b110d7-fef3-4638-8960-d0787e799f35 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:08.222903 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-29b110d7-fef3-4638-8960-d0787e799f35 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:08.229846 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-29b110d7-fef3-4638-8960-d0787e799f35 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:08.230361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-29b110d7-fef3-4638-8960-d0787e799f35 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:08.230796 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-29b110d7-fef3-4638-8960-d0787e799f35 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:08.231470 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-29b110d7-fef3-4638-8960-d0787e799f35 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:08.231922 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-29b110d7-fef3-4638-8960-d0787e799f35 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:08.232341 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-29b110d7-fef3-4638-8960-d0787e799f35 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:08.308151 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8271cb33-a1c5-4f0f-8d88-a98a50b8889c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:08.316405 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8271cb33-a1c5-4f0f-8d88-a98a50b8889c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1675 microversion: 2.1 time: 0.263718 Sep 13 07:10:08.316987 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 469/973] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:08 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1675 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:08.452485 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-29b110d7-fef3-4638-8960-d0787e799f35 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:08.461611 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-29b110d7-fef3-4638-8960-d0787e799f35 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 200 len: 1266 microversion: 2.1 time: 0.243306 Sep 13 07:10:08.462231 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 505/974] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:08 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:08.588857 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-4783ca82-1e33-4345-ad13-85da83f4f3cd req-7a49f0dc-da22-483f-83cd-5157db3bf617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e083757-8d71-44e3-a1c7-adca051e9296", "name": "network-vif-plugged", "status": "completed", "tag": "7ac4efce-383d-4358-82c8-5099b44c4a3d"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:10:08.600313 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-4783ca82-1e33-4345-ad13-85da83f4f3cd req-7a49f0dc-da22-483f-83cd-5157db3bf617 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:08.601144 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-4783ca82-1e33-4345-ad13-85da83f4f3cd req-7a49f0dc-da22-483f-83cd-5157db3bf617 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:08.601874 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-4783ca82-1e33-4345-ad13-85da83f4f3cd req-7a49f0dc-da22-483f-83cd-5157db3bf617 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:08.613730 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-4783ca82-1e33-4345-ad13-85da83f4f3cd req-7a49f0dc-da22-483f-83cd-5157db3bf617 service nova] Creating event network-vif-plugged:7ac4efce-383d-4358-82c8-5099b44c4a3d for instance 7e083757-8d71-44e3-a1c7-adca051e9296 on hv-cinder-85694 Sep 13 07:10:08.619146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-4783ca82-1e33-4345-ad13-85da83f4f3cd req-7a49f0dc-da22-483f-83cd-5157db3bf617 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035097 Sep 13 07:10:08.619954 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 470/975] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:10:08.792771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-710f8c99-6ae6-460c-b43f-b3945ea3b455 req-2df4f0b4-7fa2-4cf8-aecc-548a0d929803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d8a213-41c7-497e-a6a1-82dea1b238d7", "name": "network-vif-deleted", "tag": "ffece28d-11d9-4c48-9e40-189550016430"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:10:08.810843 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-710f8c99-6ae6-460c-b43f-b3945ea3b455 req-2df4f0b4-7fa2-4cf8-aecc-548a0d929803 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:08.811812 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-710f8c99-6ae6-460c-b43f-b3945ea3b455 req-2df4f0b4-7fa2-4cf8-aecc-548a0d929803 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:08.812504 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-710f8c99-6ae6-460c-b43f-b3945ea3b455 req-2df4f0b4-7fa2-4cf8-aecc-548a0d929803 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:08.830003 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-710f8c99-6ae6-460c-b43f-b3945ea3b455 req-2df4f0b4-7fa2-4cf8-aecc-548a0d929803 service nova] Creating event network-vif-deleted:ffece28d-11d9-4c48-9e40-189550016430 for instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 on hv-cinder-85694 Sep 13 07:10:08.835668 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-710f8c99-6ae6-460c-b43f-b3945ea3b455 req-2df4f0b4-7fa2-4cf8-aecc-548a0d929803 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046509 Sep 13 07:10:08.836874 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 506/976] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:10:09.340392 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ccdbbd6f-6264-4864-b5e7-279d0a49583b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:09.341188 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ccdbbd6f-6264-4864-b5e7-279d0a49583b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:09.347697 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ccdbbd6f-6264-4864-b5e7-279d0a49583b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:09.348188 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ccdbbd6f-6264-4864-b5e7-279d0a49583b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:09.348622 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ccdbbd6f-6264-4864-b5e7-279d0a49583b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:09.349835 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ccdbbd6f-6264-4864-b5e7-279d0a49583b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:09.350488 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ccdbbd6f-6264-4864-b5e7-279d0a49583b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:09.350920 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ccdbbd6f-6264-4864-b5e7-279d0a49583b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:09.386024 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ccdbbd6f-6264-4864-b5e7-279d0a49583b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:09.386348 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ccdbbd6f-6264-4864-b5e7-279d0a49583b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:09.386788 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ccdbbd6f-6264-4864-b5e7-279d0a49583b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:09.387268 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-ccdbbd6f-6264-4864-b5e7-279d0a49583b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lazy-loading 'fault' on Instance uuid 14d8a213-41c7-497e-a6a1-82dea1b238d7 {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:10:09.433256 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ccdbbd6f-6264-4864-b5e7-279d0a49583b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:09.441429 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ccdbbd6f-6264-4864-b5e7-279d0a49583b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1328 microversion: 2.1 time: 0.105754 Sep 13 07:10:09.442015 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 471/977] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:09 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1328 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:10:09.486229 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9db6322c-2db1-4a8f-b3e6-1ecb4c144b3c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:09.486910 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9db6322c-2db1-4a8f-b3e6-1ecb4c144b3c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:09.494488 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9db6322c-2db1-4a8f-b3e6-1ecb4c144b3c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:09.495439 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9db6322c-2db1-4a8f-b3e6-1ecb4c144b3c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:09.496024 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9db6322c-2db1-4a8f-b3e6-1ecb4c144b3c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:09.497076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9db6322c-2db1-4a8f-b3e6-1ecb4c144b3c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:09.497798 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9db6322c-2db1-4a8f-b3e6-1ecb4c144b3c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:09.498387 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9db6322c-2db1-4a8f-b3e6-1ecb4c144b3c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:09.646517 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9db6322c-2db1-4a8f-b3e6-1ecb4c144b3c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:09.654768 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9db6322c-2db1-4a8f-b3e6-1ecb4c144b3c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 200 len: 1266 microversion: 2.1 time: 0.173322 Sep 13 07:10:09.655359 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 507/978] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:09 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:10.465500 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2c3b21f8-258f-4db6-8d6d-d5095b75df94 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:10.466167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2c3b21f8-258f-4db6-8d6d-d5095b75df94 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:10.473113 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2c3b21f8-258f-4db6-8d6d-d5095b75df94 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:10.473593 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2c3b21f8-258f-4db6-8d6d-d5095b75df94 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:10.474038 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2c3b21f8-258f-4db6-8d6d-d5095b75df94 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:10.474849 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2c3b21f8-258f-4db6-8d6d-d5095b75df94 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:10.475322 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2c3b21f8-258f-4db6-8d6d-d5095b75df94 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:10.475748 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2c3b21f8-258f-4db6-8d6d-d5095b75df94 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:10.508755 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2c3b21f8-258f-4db6-8d6d-d5095b75df94 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:10.509243 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2c3b21f8-258f-4db6-8d6d-d5095b75df94 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:10.509644 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2c3b21f8-258f-4db6-8d6d-d5095b75df94 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:10.510110 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-2c3b21f8-258f-4db6-8d6d-d5095b75df94 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lazy-loading 'fault' on Instance uuid 14d8a213-41c7-497e-a6a1-82dea1b238d7 {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:10:10.558546 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2c3b21f8-258f-4db6-8d6d-d5095b75df94 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:10.567213 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2c3b21f8-258f-4db6-8d6d-d5095b75df94 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 200 len: 1328 microversion: 2.1 time: 0.105829 Sep 13 07:10:10.567849 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 472/979] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:10 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 1328 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:10.684711 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-814fe79f-546f-4ecd-9039-939d00bd73b4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:10.685424 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-814fe79f-546f-4ecd-9039-939d00bd73b4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:10.694731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-814fe79f-546f-4ecd-9039-939d00bd73b4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:10.695309 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-814fe79f-546f-4ecd-9039-939d00bd73b4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:10.695848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-814fe79f-546f-4ecd-9039-939d00bd73b4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:10.696702 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-814fe79f-546f-4ecd-9039-939d00bd73b4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:10.697261 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-814fe79f-546f-4ecd-9039-939d00bd73b4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:10.697783 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-814fe79f-546f-4ecd-9039-939d00bd73b4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:10.833446 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-814fe79f-546f-4ecd-9039-939d00bd73b4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:10.844742 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-814fe79f-546f-4ecd-9039-939d00bd73b4 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 200 len: 1453 microversion: 2.1 time: 0.165262 Sep 13 07:10:10.845312 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 508/980] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:10 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:10.868824 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-209cb7d9-f78d-4bdb-868e-2f6b5c948256 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:10.869436 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-209cb7d9-f78d-4bdb-868e-2f6b5c948256 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:10.875794 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-209cb7d9-f78d-4bdb-868e-2f6b5c948256 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:10.876276 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-209cb7d9-f78d-4bdb-868e-2f6b5c948256 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:10.876706 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-209cb7d9-f78d-4bdb-868e-2f6b5c948256 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:10.877395 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-209cb7d9-f78d-4bdb-868e-2f6b5c948256 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:10.877843 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-209cb7d9-f78d-4bdb-868e-2f6b5c948256 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:10.878307 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-209cb7d9-f78d-4bdb-868e-2f6b5c948256 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:11.022283 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-209cb7d9-f78d-4bdb-868e-2f6b5c948256 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:11.034621 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-209cb7d9-f78d-4bdb-868e-2f6b5c948256 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 200 len: 1453 microversion: 2.1 time: 0.169310 Sep 13 07:10:11.035269 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 473/981] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:10 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:11.591160 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c424a3a8-7a91-406f-afe9-ca2d61942b37 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:11.592124 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c424a3a8-7a91-406f-afe9-ca2d61942b37 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:11.598392 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c424a3a8-7a91-406f-afe9-ca2d61942b37 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:11.598884 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c424a3a8-7a91-406f-afe9-ca2d61942b37 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:11.599397 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c424a3a8-7a91-406f-afe9-ca2d61942b37 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:11.600284 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c424a3a8-7a91-406f-afe9-ca2d61942b37 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:11.600935 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c424a3a8-7a91-406f-afe9-ca2d61942b37 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:11.601357 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c424a3a8-7a91-406f-afe9-ca2d61942b37 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:11.619881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-c424a3a8-7a91-406f-afe9-ca2d61942b37 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] HTTP exception thrown: Instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 could not be found. Sep 13 07:10:11.621519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c424a3a8-7a91-406f-afe9-ca2d61942b37 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Request method failure captured: Sep 13 07:10:11.621519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 HTTP/1.1 Sep 13 07:10:11.621519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:10:11.621519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:10:11.621519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:10:11.621519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:10:11.621519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:10:11.621519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:10:11.621519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:10:11.621519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:10:11.621519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICwRXHaLB3-EQWC43eGzybeFNOVO90FLZ8n2hx_2wnnotEdpnw2BnRvWHXRo8T6k_h3qaMk9UZ9FYtnDqnLkCq2r8mMJMJ1qHvn3WCEhSD2xSd0dOwRy9g0-jhla8rktopMvy3qWjhCXaLWzReBYAzMHKlDUPTU7ai66-9yj5xr4EGA Sep 13 07:10:11.621519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:10:11.621519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:10:11.621519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:10:11.621519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:10:11.621519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:10:11.621519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:10:11.621519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 0f2d19ffb32443babaa154c5766b6982 Sep 13 07:10:11.621519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeTestJSON-1423067582 Sep 13 07:10:11.621519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:10:11.621519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:10:11.623314 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f2d19ffb32443babaa154c5766b6982"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f2d19ffb32443babaa154c5766b6982"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f2d19ffb32443babaa154c5766b6982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f2d19ffb32443babaa154c5766b6982", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:10:11.623314 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeTestJSON-1423067582 Sep 13 07:10:11.623314 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 0f2d19ffb32443babaa154c5766b6982 Sep 13 07:10:11.623314 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1423067582 Sep 13 07:10:11.623314 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeTestJSON-1423067582-project Sep 13 07:10:11.623314 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:10:11.623314 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:10:11.623314 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: a8576530b4ed4749a1e138f975d9b8b9 Sep 13 07:10:11.623314 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeTestJSON-1423067582-project Sep 13 07:10:11.623314 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:10:11.623314 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 could not be found. Sep 13 07:10:11.623314 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': '14d8a213-41c7-497e-a6a1-82dea1b238d7'} Sep 13 07:10:11.624326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:10:11.624326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:10:11.624326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:10:11.624326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:10:11.624326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:10:11.624326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:10:11.624326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:10:11.624326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:10:11.624326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:10:11.624326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:10:11.624326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 could not be found. Sep 13 07:10:11.624326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:10:11.624326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:10:11.624326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:10:11.624326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:10:11.624326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:10:11.624326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:10:11.624326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:10:11.624326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:10:11.624326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:10:11.625916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:10:11.625916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:10:11.625916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:10:11.625916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:10:11.625916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:10:11.625916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:10:11.625916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:10:11.625916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 could not be found. Sep 13 07:10:11.625916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:10:11.625916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:10:11.625916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:10:11.625916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:10:11.625916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:10:11.625916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:10:11.625916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:10:11.625916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:10:11.625916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 could not be found. Sep 13 07:10:11.625916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:10:11.628009 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c424a3a8-7a91-406f-afe9-ca2d61942b37 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Returning 404 to user: Instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:10:11.628846 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c424a3a8-7a91-406f-afe9-ca2d61942b37 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 404 len: 111 microversion: 2.1 time: 0.041704 Sep 13 07:10:11.629392 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 509/982] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:11 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:10:11.638680 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9bb923d8-09b7-4c80-8ad9-0fe010131e97 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '.version_select at 0x7f4c196be040>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:11.659805 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9bb923d8-09b7-4c80-8ad9-0fe010131e97 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744464638" status: 202 len: 0 microversion: 2.1 time: 0.025033 Sep 13 07:10:11.660392 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 474/983] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Sep 13 07:10:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744464638 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:10:12.707838 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8765ef47-4d27-423b-851f-6883ccf447ef tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Action: 'create', calling method: .version_select at 0x7f4c195d08b0>, body: {"keypair": {"name": "tempest-keypair-174354146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDJ3TgKyqn6Ko0Q58cFnU5r2MRlDl1qD4FKho/i/H6k6WpERZPGxr/9KB6Jsooo56bUaW/dr6gE9J20AfKAZcDVBN3KNYjfcHE7TgrXsuAy1tKRF6S5pj5CQB+9QWMAUA=="}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:10:12.723587 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-8765ef47-4d27-423b-851f-6883ccf447ef tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Getting quotas for project 0f2d19ffb32443babaa154c5766b6982. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:10:12.727681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-8765ef47-4d27-423b-851f-6883ccf447ef tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Getting quotas for user a8576530b4ed4749a1e138f975d9b8b9 and project 0f2d19ffb32443babaa154c5766b6982. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:10:12.750497 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8765ef47-4d27-423b-851f-6883ccf447ef tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046934 Sep 13 07:10:12.751232 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 510/984] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Sep 13 07:10:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:10:12.832928 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-645b56c4-4114-4094-8751-6c6fa7cb52ae req-9c634711-3578-4669-ba2f-6d30cfd75d53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e083757-8d71-44e3-a1c7-adca051e9296", "tag": "7ac4efce-383d-4358-82c8-5099b44c4a3d"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:10:12.843982 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-645b56c4-4114-4094-8751-6c6fa7cb52ae req-9c634711-3578-4669-ba2f-6d30cfd75d53 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:12.844733 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-645b56c4-4114-4094-8751-6c6fa7cb52ae req-9c634711-3578-4669-ba2f-6d30cfd75d53 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:12.845328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-645b56c4-4114-4094-8751-6c6fa7cb52ae req-9c634711-3578-4669-ba2f-6d30cfd75d53 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:12.857347 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-645b56c4-4114-4094-8751-6c6fa7cb52ae req-9c634711-3578-4669-ba2f-6d30cfd75d53 service nova] Creating event network-changed:7ac4efce-383d-4358-82c8-5099b44c4a3d for instance 7e083757-8d71-44e3-a1c7-adca051e9296 on hv-cinder-85694 Sep 13 07:10:12.862978 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-645b56c4-4114-4094-8751-6c6fa7cb52ae req-9c634711-3578-4669-ba2f-6d30cfd75d53 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034371 Sep 13 07:10:12.863893 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 475/985] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:10:14.146483 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-85b3e726-5021-4e84-9c90-de1891f42c76 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1330473740", "imageRef": "19a6700e-e153-4bea-87aa-036bfccf0ecd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de769f76-c16e-4308-8d87-174634377b5a"}], "security_groups": [{"name": "tempest-securitygroup--930494834"}], "key_name": "tempest-keypair-174354146", "user_data": "}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:10:14.260096 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-85b3e726-5021-4e84-9c90-de1891f42c76 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] validate_networks() for [('de769f76-c16e-4308-8d87-174634377b5a', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:10:14.912386 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-85b3e726-5021-4e84-9c90-de1891f42c76 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:10:14.912787 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-85b3e726-5021-4e84-9c90-de1891f42c76 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:10:14.913304 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-85b3e726-5021-4e84-9c90-de1891f42c76 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:10:14.913710 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-85b3e726-5021-4e84-9c90-de1891f42c76 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:10:14.914114 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-85b3e726-5021-4e84-9c90-de1891f42c76 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:10:14.923343 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85b3e726-5021-4e84-9c90-de1891f42c76 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:14.923825 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85b3e726-5021-4e84-9c90-de1891f42c76 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:14.924259 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85b3e726-5021-4e84-9c90-de1891f42c76 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:14.924978 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85b3e726-5021-4e84-9c90-de1891f42c76 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:14.925426 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85b3e726-5021-4e84-9c90-de1891f42c76 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:14.925846 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85b3e726-5021-4e84-9c90-de1891f42c76 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:14.944341 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-85b3e726-5021-4e84-9c90-de1891f42c76 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Getting quotas for project 0f2d19ffb32443babaa154c5766b6982. Resources: {'instances', 'cores', 'ram'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:10:14.948750 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-85b3e726-5021-4e84-9c90-de1891f42c76 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Getting quotas for user a8576530b4ed4749a1e138f975d9b8b9 and project 0f2d19ffb32443babaa154c5766b6982. Resources: {'instances', 'cores', 'ram'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:10:14.960917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-85b3e726-5021-4e84-9c90-de1891f42c76 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:10:14.963250 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-85b3e726-5021-4e84-9c90-de1891f42c76 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='19a6700e-e153-4bea-87aa-036bfccf0ecd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:10:15.017055 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-85b3e726-5021-4e84-9c90-de1891f42c76 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.875489 Sep 13 07:10:15.017678 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 511/986] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Sep 13 07:10:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 07:10:15.030855 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3b4dc7b0-fd93-4f8c-bb96-da2a8600f3af tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:15.031565 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3b4dc7b0-fd93-4f8c-bb96-da2a8600f3af tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:15.086941 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3b4dc7b0-fd93-4f8c-bb96-da2a8600f3af tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:15.093839 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3b4dc7b0-fd93-4f8c-bb96-da2a8600f3af tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344" status: 200 len: 1237 microversion: 2.1 time: 0.067270 Sep 13 07:10:15.094528 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 476/987] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:15 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:16.119350 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bf6cd38e-15cc-4f9c-ba17-fca4c35f062c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:16.120081 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bf6cd38e-15cc-4f9c-ba17-fca4c35f062c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:16.128380 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf6cd38e-15cc-4f9c-ba17-fca4c35f062c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:16.128991 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf6cd38e-15cc-4f9c-ba17-fca4c35f062c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:16.129584 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf6cd38e-15cc-4f9c-ba17-fca4c35f062c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:16.130721 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf6cd38e-15cc-4f9c-ba17-fca4c35f062c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:16.131175 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf6cd38e-15cc-4f9c-ba17-fca4c35f062c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:16.131639 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf6cd38e-15cc-4f9c-ba17-fca4c35f062c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:16.254312 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bf6cd38e-15cc-4f9c-ba17-fca4c35f062c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:16.265027 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bf6cd38e-15cc-4f9c-ba17-fca4c35f062c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344" status: 200 len: 1289 microversion: 2.1 time: 0.151716 Sep 13 07:10:16.278544 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 512/988] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:16 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 => generated 1289 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:17.288954 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-df434364-12b2-4719-a131-882f6bfa095c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:17.289544 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-df434364-12b2-4719-a131-882f6bfa095c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:17.298388 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df434364-12b2-4719-a131-882f6bfa095c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:17.298866 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df434364-12b2-4719-a131-882f6bfa095c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:17.299295 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df434364-12b2-4719-a131-882f6bfa095c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:17.300007 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df434364-12b2-4719-a131-882f6bfa095c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:17.300447 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df434364-12b2-4719-a131-882f6bfa095c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:17.300858 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df434364-12b2-4719-a131-882f6bfa095c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:17.509152 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-df434364-12b2-4719-a131-882f6bfa095c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:17.517489 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-df434364-12b2-4719-a131-882f6bfa095c tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344" status: 200 len: 1362 microversion: 2.1 time: 0.232532 Sep 13 07:10:17.518074 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 477/989] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:17 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:17.870057 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-e1d7012f-d22f-48d6-b2b1-8bf4441d5a8c req-6c1b7301-d1dc-423e-aea4-a29ed9142d05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d47962b6-2a8d-498d-8ab5-213c713eb344", "tag": "a01962be-937c-49e6-953b-c81b6d1f6bfc"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:10:17.880562 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e1d7012f-d22f-48d6-b2b1-8bf4441d5a8c req-6c1b7301-d1dc-423e-aea4-a29ed9142d05 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:17.881149 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e1d7012f-d22f-48d6-b2b1-8bf4441d5a8c req-6c1b7301-d1dc-423e-aea4-a29ed9142d05 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:17.881562 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e1d7012f-d22f-48d6-b2b1-8bf4441d5a8c req-6c1b7301-d1dc-423e-aea4-a29ed9142d05 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:17.893106 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-e1d7012f-d22f-48d6-b2b1-8bf4441d5a8c req-6c1b7301-d1dc-423e-aea4-a29ed9142d05 service nova] Creating event network-changed:a01962be-937c-49e6-953b-c81b6d1f6bfc for instance d47962b6-2a8d-498d-8ab5-213c713eb344 on hv-cinder-85694 Sep 13 07:10:17.898021 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-e1d7012f-d22f-48d6-b2b1-8bf4441d5a8c req-6c1b7301-d1dc-423e-aea4-a29ed9142d05 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031876 Sep 13 07:10:17.898674 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 513/990] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:10:18.546248 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6f3c419f-5c75-4579-8420-ac5611ac2009 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:18.547279 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6f3c419f-5c75-4579-8420-ac5611ac2009 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:18.558653 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f3c419f-5c75-4579-8420-ac5611ac2009 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:18.559642 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f3c419f-5c75-4579-8420-ac5611ac2009 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:18.560140 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f3c419f-5c75-4579-8420-ac5611ac2009 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:18.561318 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f3c419f-5c75-4579-8420-ac5611ac2009 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:18.562125 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f3c419f-5c75-4579-8420-ac5611ac2009 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:18.562810 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6f3c419f-5c75-4579-8420-ac5611ac2009 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:18.700095 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6f3c419f-5c75-4579-8420-ac5611ac2009 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:18.711216 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6f3c419f-5c75-4579-8420-ac5611ac2009 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344" status: 200 len: 1362 microversion: 2.1 time: 0.171518 Sep 13 07:10:18.711788 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 478/991] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:18 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:19.736678 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5c45119c-0d57-4932-8f00-b47f2587fa28 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:19.737371 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5c45119c-0d57-4932-8f00-b47f2587fa28 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:19.745603 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c45119c-0d57-4932-8f00-b47f2587fa28 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:19.746096 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c45119c-0d57-4932-8f00-b47f2587fa28 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:19.746554 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c45119c-0d57-4932-8f00-b47f2587fa28 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:19.747238 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c45119c-0d57-4932-8f00-b47f2587fa28 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:19.747682 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c45119c-0d57-4932-8f00-b47f2587fa28 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:19.748117 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c45119c-0d57-4932-8f00-b47f2587fa28 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:19.882203 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5c45119c-0d57-4932-8f00-b47f2587fa28 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:19.890111 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5c45119c-0d57-4932-8f00-b47f2587fa28 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344" status: 200 len: 1362 microversion: 2.1 time: 0.158518 Sep 13 07:10:19.890682 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 514/992] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:19 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:20.917045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3925407e-11c8-4cae-b64c-a9f7b5fb04e5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:20.918014 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3925407e-11c8-4cae-b64c-a9f7b5fb04e5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:20.928489 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3925407e-11c8-4cae-b64c-a9f7b5fb04e5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:20.928962 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3925407e-11c8-4cae-b64c-a9f7b5fb04e5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:20.929395 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3925407e-11c8-4cae-b64c-a9f7b5fb04e5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:20.930108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3925407e-11c8-4cae-b64c-a9f7b5fb04e5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:20.930909 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3925407e-11c8-4cae-b64c-a9f7b5fb04e5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:20.931330 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3925407e-11c8-4cae-b64c-a9f7b5fb04e5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:21.068496 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3925407e-11c8-4cae-b64c-a9f7b5fb04e5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:21.076860 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3925407e-11c8-4cae-b64c-a9f7b5fb04e5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344" status: 200 len: 1362 microversion: 2.1 time: 0.166485 Sep 13 07:10:21.077461 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 479/993] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:20 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:22.104823 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-337d381c-da64-431b-983d-081ef6f07e40 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:22.105578 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-337d381c-da64-431b-983d-081ef6f07e40 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:22.114003 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-337d381c-da64-431b-983d-081ef6f07e40 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:22.115071 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-337d381c-da64-431b-983d-081ef6f07e40 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:22.115287 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-337d381c-da64-431b-983d-081ef6f07e40 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:22.116091 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-337d381c-da64-431b-983d-081ef6f07e40 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:22.116648 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-337d381c-da64-431b-983d-081ef6f07e40 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:22.117171 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-337d381c-da64-431b-983d-081ef6f07e40 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:22.138222 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:22.255935 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-337d381c-da64-431b-983d-081ef6f07e40 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:22.264100 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-337d381c-da64-431b-983d-081ef6f07e40 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344" status: 200 len: 1362 microversion: 2.1 time: 0.164256 Sep 13 07:10:22.264659 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 515/994] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:22 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:23.286726 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e51f67f0-2cef-4884-b5de-2eb21cfdef57 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:23.287489 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e51f67f0-2cef-4884-b5de-2eb21cfdef57 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:23.289959 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:23.295695 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e51f67f0-2cef-4884-b5de-2eb21cfdef57 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:23.296136 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e51f67f0-2cef-4884-b5de-2eb21cfdef57 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:23.296560 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e51f67f0-2cef-4884-b5de-2eb21cfdef57 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:23.297242 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e51f67f0-2cef-4884-b5de-2eb21cfdef57 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:23.297691 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e51f67f0-2cef-4884-b5de-2eb21cfdef57 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:23.298100 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e51f67f0-2cef-4884-b5de-2eb21cfdef57 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:23.301558 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=97 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:23.439243 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e51f67f0-2cef-4884-b5de-2eb21cfdef57 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:23.447688 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e51f67f0-2cef-4884-b5de-2eb21cfdef57 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344" status: 200 len: 1362 microversion: 2.1 time: 0.165070 Sep 13 07:10:23.448255 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 480/995] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:23 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:24.478654 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c6d6d3c3-7bee-41cc-9a90-97398d981e95 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:24.479349 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c6d6d3c3-7bee-41cc-9a90-97398d981e95 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:24.482729 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:24.490511 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6d6d3c3-7bee-41cc-9a90-97398d981e95 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:24.491127 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6d6d3c3-7bee-41cc-9a90-97398d981e95 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:24.491672 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6d6d3c3-7bee-41cc-9a90-97398d981e95 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:24.492513 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6d6d3c3-7bee-41cc-9a90-97398d981e95 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:24.493108 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6d6d3c3-7bee-41cc-9a90-97398d981e95 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:24.493641 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6d6d3c3-7bee-41cc-9a90-97398d981e95 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:24.629470 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c6d6d3c3-7bee-41cc-9a90-97398d981e95 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:24.637818 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c6d6d3c3-7bee-41cc-9a90-97398d981e95 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344" status: 200 len: 1362 microversion: 2.1 time: 0.165909 Sep 13 07:10:24.638422 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 516/996] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:24 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:24.779856 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-543cd565-18ae-4f00-a3be-0f5fa46a858a req-3126310d-8fee-4138-9cd4-7b279016b97d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d47962b6-2a8d-498d-8ab5-213c713eb344", "name": "network-vif-plugged", "status": "completed", "tag": "a01962be-937c-49e6-953b-c81b6d1f6bfc"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:10:24.790585 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-543cd565-18ae-4f00-a3be-0f5fa46a858a req-3126310d-8fee-4138-9cd4-7b279016b97d service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:24.791068 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-543cd565-18ae-4f00-a3be-0f5fa46a858a req-3126310d-8fee-4138-9cd4-7b279016b97d service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:24.791495 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-543cd565-18ae-4f00-a3be-0f5fa46a858a req-3126310d-8fee-4138-9cd4-7b279016b97d service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:24.803188 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-543cd565-18ae-4f00-a3be-0f5fa46a858a req-3126310d-8fee-4138-9cd4-7b279016b97d service nova] Creating event network-vif-plugged:a01962be-937c-49e6-953b-c81b6d1f6bfc for instance d47962b6-2a8d-498d-8ab5-213c713eb344 on hv-cinder-85694 Sep 13 07:10:24.808658 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-543cd565-18ae-4f00-a3be-0f5fa46a858a req-3126310d-8fee-4138-9cd4-7b279016b97d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032551 Sep 13 07:10:24.809240 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 481/997] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:10:25.665361 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dc08e16f-8e76-4850-90c1-3b9f0373699f tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:25.666323 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-dc08e16f-8e76-4850-90c1-3b9f0373699f tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:25.669143 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:25.670421 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=10 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:25.679603 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc08e16f-8e76-4850-90c1-3b9f0373699f tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:25.680092 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc08e16f-8e76-4850-90c1-3b9f0373699f tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:25.680868 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc08e16f-8e76-4850-90c1-3b9f0373699f tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:25.681555 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc08e16f-8e76-4850-90c1-3b9f0373699f tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:25.682009 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc08e16f-8e76-4850-90c1-3b9f0373699f tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:25.682454 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc08e16f-8e76-4850-90c1-3b9f0373699f tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:25.817141 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-dc08e16f-8e76-4850-90c1-3b9f0373699f tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:25.825136 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dc08e16f-8e76-4850-90c1-3b9f0373699f tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344" status: 200 len: 1362 microversion: 2.1 time: 0.167127 Sep 13 07:10:25.825681 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 517/998] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:25 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:26.844686 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:26.849973 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3ef78c3a-e932-40b1-93db-087382607170 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:26.850903 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3ef78c3a-e932-40b1-93db-087382607170 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:26.857800 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3ef78c3a-e932-40b1-93db-087382607170 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:26.858317 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3ef78c3a-e932-40b1-93db-087382607170 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:26.858728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3ef78c3a-e932-40b1-93db-087382607170 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:26.859450 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3ef78c3a-e932-40b1-93db-087382607170 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:26.860014 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3ef78c3a-e932-40b1-93db-087382607170 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:26.861099 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3ef78c3a-e932-40b1-93db-087382607170 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:27.013664 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3ef78c3a-e932-40b1-93db-087382607170 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:10:27.024722 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3ef78c3a-e932-40b1-93db-087382607170 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344" status: 200 len: 1549 microversion: 2.1 time: 0.180828 Sep 13 07:10:27.025313 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 482/999] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:10:26 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 => generated 1549 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:10:27.059587 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1fdcfbcc-d19a-4bbe-85a0-ab6068c521b5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:10:27.060228 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1fdcfbcc-d19a-4bbe-85a0-ab6068c521b5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:10:27.067814 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1fdcfbcc-d19a-4bbe-85a0-ab6068c521b5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:27.068466 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1fdcfbcc-d19a-4bbe-85a0-ab6068c521b5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:27.068930 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1fdcfbcc-d19a-4bbe-85a0-ab6068c521b5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:27.069665 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1fdcfbcc-d19a-4bbe-85a0-ab6068c521b5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:27.070156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1fdcfbcc-d19a-4bbe-85a0-ab6068c521b5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:27.070605 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1fdcfbcc-d19a-4bbe-85a0-ab6068c521b5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:27.158462 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1fdcfbcc-d19a-4bbe-85a0-ab6068c521b5 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102688 Sep 13 07:10:27.159384 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 518/1000] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Sep 13 07:10:27 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:10:28.177183 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-6cfe3f4c-0e1e-4f4a-b5a2-7510f4f48943 req-08fd81e4-b2ce-4183-a553-5df8a1004fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d47962b6-2a8d-498d-8ab5-213c713eb344", "tag": "a01962be-937c-49e6-953b-c81b6d1f6bfc"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:10:28.187925 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-6cfe3f4c-0e1e-4f4a-b5a2-7510f4f48943 req-08fd81e4-b2ce-4183-a553-5df8a1004fc4 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:10:28.188401 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-6cfe3f4c-0e1e-4f4a-b5a2-7510f4f48943 req-08fd81e4-b2ce-4183-a553-5df8a1004fc4 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:10:28.188825 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-6cfe3f4c-0e1e-4f4a-b5a2-7510f4f48943 req-08fd81e4-b2ce-4183-a553-5df8a1004fc4 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:10:28.200603 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-6cfe3f4c-0e1e-4f4a-b5a2-7510f4f48943 req-08fd81e4-b2ce-4183-a553-5df8a1004fc4 service nova] Creating event network-changed:a01962be-937c-49e6-953b-c81b6d1f6bfc for instance d47962b6-2a8d-498d-8ab5-213c713eb344 on hv-cinder-85694 Sep 13 07:10:28.205867 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-6cfe3f4c-0e1e-4f4a-b5a2-7510f4f48943 req-08fd81e4-b2ce-4183-a553-5df8a1004fc4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032404 Sep 13 07:10:28.206753 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 483/1001] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:04.199927 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=5 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:11:04.201690 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=18 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:11:04.205686 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3fb126e9-0638-4be9-9dfc-6f5199833cd2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:04.206257 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3fb126e9-0638-4be9-9dfc-6f5199833cd2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:04.213221 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3fb126e9-0638-4be9-9dfc-6f5199833cd2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:04.213717 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3fb126e9-0638-4be9-9dfc-6f5199833cd2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:04.214170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3fb126e9-0638-4be9-9dfc-6f5199833cd2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:04.214841 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3fb126e9-0638-4be9-9dfc-6f5199833cd2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:04.215284 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3fb126e9-0638-4be9-9dfc-6f5199833cd2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:04.215698 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3fb126e9-0638-4be9-9dfc-6f5199833cd2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:04.239517 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3fb126e9-0638-4be9-9dfc-6f5199833cd2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/ips" status: 200 len: 147 microversion: 2.1 time: 0.042238 Sep 13 07:11:04.240069 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 519/1002] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Sep 13 07:11:04 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/ips => generated 147 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:05.610112 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=7 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:11:05.610844 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=15 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:11:05.616127 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e785e95d-6c71-445c-91fa-c38ce905f849 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b47cab32-3c7f-40ec-a4ef-aff7e6337f0b"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:11:05.618864 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e785e95d-6c71-445c-91fa-c38ce905f849 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:05.626810 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e785e95d-6c71-445c-91fa-c38ce905f849 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:05.627289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e785e95d-6c71-445c-91fa-c38ce905f849 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:05.627715 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e785e95d-6c71-445c-91fa-c38ce905f849 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:05.628399 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e785e95d-6c71-445c-91fa-c38ce905f849 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:05.628851 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e785e95d-6c71-445c-91fa-c38ce905f849 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:05.629421 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e785e95d-6c71-445c-91fa-c38ce905f849 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:06.109665 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e785e95d-6c71-445c-91fa-c38ce905f849 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "POST /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.499853 Sep 13 07:11:06.110341 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 484/1003] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Sep 13 07:11:05 2022] POST /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments => generated 194 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:13.719715 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-443ad7bf-adb0-4ddb-b682-14e684dc89fe tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:13.721923 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-443ad7bf-adb0-4ddb-b682-14e684dc89fe tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:13.728808 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-443ad7bf-adb0-4ddb-b682-14e684dc89fe tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:13.729334 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-443ad7bf-adb0-4ddb-b682-14e684dc89fe tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:13.729765 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-443ad7bf-adb0-4ddb-b682-14e684dc89fe tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:13.730493 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-443ad7bf-adb0-4ddb-b682-14e684dc89fe tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:13.730948 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-443ad7bf-adb0-4ddb-b682-14e684dc89fe tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:13.731365 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-443ad7bf-adb0-4ddb-b682-14e684dc89fe tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:13.763546 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-443ad7bf-adb0-4ddb-b682-14e684dc89fe tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048562 Sep 13 07:11:13.764065 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 520/1004] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Sep 13 07:11:13 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:13.776233 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e645c26d-424f-49ea-a53d-48654e65f4f4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:13.776835 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e645c26d-424f-49ea-a53d-48654e65f4f4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:13.785175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e645c26d-424f-49ea-a53d-48654e65f4f4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:13.785913 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e645c26d-424f-49ea-a53d-48654e65f4f4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:13.786615 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e645c26d-424f-49ea-a53d-48654e65f4f4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:13.787761 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e645c26d-424f-49ea-a53d-48654e65f4f4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:13.788523 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e645c26d-424f-49ea-a53d-48654e65f4f4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:13.789025 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e645c26d-424f-49ea-a53d-48654e65f4f4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:13.828942 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e645c26d-424f-49ea-a53d-48654e65f4f4 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments/b47cab32-3c7f-40ec-a4ef-aff7e6337f0b" status: 200 len: 194 microversion: 2.1 time: 0.057012 Sep 13 07:11:13.830028 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 485/1005] 10.222.0.25 () {58 vars in 1413 bytes} [Tue Sep 13 07:11:13 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments/b47cab32-3c7f-40ec-a4ef-aff7e6337f0b => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:15.181731 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f3934b2a-8781-49d7-a3ad-3928acf7a3a2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f86ca8f4-7338-4ad8-89b0-8234b83cad02"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:11:15.185547 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f3934b2a-8781-49d7-a3ad-3928acf7a3a2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:15.193497 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f3934b2a-8781-49d7-a3ad-3928acf7a3a2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:15.193984 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f3934b2a-8781-49d7-a3ad-3928acf7a3a2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:15.194446 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f3934b2a-8781-49d7-a3ad-3928acf7a3a2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:15.195133 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f3934b2a-8781-49d7-a3ad-3928acf7a3a2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:15.195590 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f3934b2a-8781-49d7-a3ad-3928acf7a3a2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:15.196007 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f3934b2a-8781-49d7-a3ad-3928acf7a3a2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:15.586897 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f3934b2a-8781-49d7-a3ad-3928acf7a3a2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "POST /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412225 Sep 13 07:11:15.587522 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 521/1006] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Sep 13 07:11:15 2022] POST /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:23.220407 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5e1ecf39-8940-45d6-93fd-d7a48ee90ad3 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:23.222775 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5e1ecf39-8940-45d6-93fd-d7a48ee90ad3 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:23.229745 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5e1ecf39-8940-45d6-93fd-d7a48ee90ad3 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:23.230258 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5e1ecf39-8940-45d6-93fd-d7a48ee90ad3 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:23.230687 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5e1ecf39-8940-45d6-93fd-d7a48ee90ad3 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:23.231375 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5e1ecf39-8940-45d6-93fd-d7a48ee90ad3 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:23.231854 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5e1ecf39-8940-45d6-93fd-d7a48ee90ad3 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:23.232272 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5e1ecf39-8940-45d6-93fd-d7a48ee90ad3 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:23.266459 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5e1ecf39-8940-45d6-93fd-d7a48ee90ad3 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049989 Sep 13 07:11:23.267271 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 486/1007] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Sep 13 07:11:23 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:23.417483 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c6c576e4-2e3a-48d1-bb80-9f96056aa35d tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:23.418234 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c6c576e4-2e3a-48d1-bb80-9f96056aa35d tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:23.425987 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6c576e4-2e3a-48d1-bb80-9f96056aa35d tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:23.426489 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6c576e4-2e3a-48d1-bb80-9f96056aa35d tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:23.426919 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6c576e4-2e3a-48d1-bb80-9f96056aa35d tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:23.427600 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6c576e4-2e3a-48d1-bb80-9f96056aa35d tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:23.428049 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6c576e4-2e3a-48d1-bb80-9f96056aa35d tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:23.428500 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c6c576e4-2e3a-48d1-bb80-9f96056aa35d tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:23.458405 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c6c576e4-2e3a-48d1-bb80-9f96056aa35d tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments/b47cab32-3c7f-40ec-a4ef-aff7e6337f0b" status: 200 len: 194 microversion: 2.1 time: 0.046234 Sep 13 07:11:23.458967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 522/1008] 10.222.0.25 () {58 vars in 1413 bytes} [Tue Sep 13 07:11:23 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments/b47cab32-3c7f-40ec-a4ef-aff7e6337f0b => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:23.469990 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b593da31-2a1a-4d9c-9caa-f2edb0ed7672 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:23.470590 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b593da31-2a1a-4d9c-9caa-f2edb0ed7672 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:23.476920 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b593da31-2a1a-4d9c-9caa-f2edb0ed7672 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:23.477395 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b593da31-2a1a-4d9c-9caa-f2edb0ed7672 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:23.477822 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b593da31-2a1a-4d9c-9caa-f2edb0ed7672 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:23.478545 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b593da31-2a1a-4d9c-9caa-f2edb0ed7672 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:23.478988 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b593da31-2a1a-4d9c-9caa-f2edb0ed7672 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:23.479403 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b593da31-2a1a-4d9c-9caa-f2edb0ed7672 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:23.559181 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-b593da31-2a1a-4d9c-9caa-f2edb0ed7672 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lazy-loading 'services' on Instance uuid d47962b6-2a8d-498d-8ab5-213c713eb344 {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:11:23.639808 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b593da31-2a1a-4d9c-9caa-f2edb0ed7672 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments/b47cab32-3c7f-40ec-a4ef-aff7e6337f0b" status: 202 len: 0 microversion: 2.1 time: 0.173632 Sep 13 07:11:23.640418 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 487/1009] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Sep 13 07:11:23 2022] DELETE /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments/b47cab32-3c7f-40ec-a4ef-aff7e6337f0b => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:11:24.766468 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5cacf944-5488-4d2d-8c80-6928a7d9352a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:24.767026 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5cacf944-5488-4d2d-8c80-6928a7d9352a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:24.773716 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5cacf944-5488-4d2d-8c80-6928a7d9352a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:24.774070 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5cacf944-5488-4d2d-8c80-6928a7d9352a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:24.774522 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5cacf944-5488-4d2d-8c80-6928a7d9352a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:24.775208 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5cacf944-5488-4d2d-8c80-6928a7d9352a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:24.775657 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5cacf944-5488-4d2d-8c80-6928a7d9352a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:24.776067 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5cacf944-5488-4d2d-8c80-6928a7d9352a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:24.807565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5cacf944-5488-4d2d-8c80-6928a7d9352a tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments/f86ca8f4-7338-4ad8-89b0-8234b83cad02" status: 200 len: 194 microversion: 2.1 time: 0.046102 Sep 13 07:11:24.808161 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 523/1010] 10.222.0.25 () {58 vars in 1413 bytes} [Tue Sep 13 07:11:24 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments/f86ca8f4-7338-4ad8-89b0-8234b83cad02 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:24.819979 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-107c789d-29d1-43a7-8646-36419317f441 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:24.820556 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-107c789d-29d1-43a7-8646-36419317f441 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:24.827061 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-107c789d-29d1-43a7-8646-36419317f441 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:24.827544 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-107c789d-29d1-43a7-8646-36419317f441 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:24.827978 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-107c789d-29d1-43a7-8646-36419317f441 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:24.828668 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-107c789d-29d1-43a7-8646-36419317f441 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:24.829118 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-107c789d-29d1-43a7-8646-36419317f441 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:24.829543 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-107c789d-29d1-43a7-8646-36419317f441 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:24.917371 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-107c789d-29d1-43a7-8646-36419317f441 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lazy-loading 'services' on Instance uuid d47962b6-2a8d-498d-8ab5-213c713eb344 {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:11:25.006107 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-107c789d-29d1-43a7-8646-36419317f441 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments/f86ca8f4-7338-4ad8-89b0-8234b83cad02" status: 202 len: 0 microversion: 2.1 time: 0.190855 Sep 13 07:11:25.006736 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 488/1011] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Sep 13 07:11:24 2022] DELETE /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments/f86ca8f4-7338-4ad8-89b0-8234b83cad02 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:11:26.186120 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-50c3fd23-4852-409c-ac22-d0f0bf743ce2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:26.188528 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-50c3fd23-4852-409c-ac22-d0f0bf743ce2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:26.195680 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-50c3fd23-4852-409c-ac22-d0f0bf743ce2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:26.196158 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-50c3fd23-4852-409c-ac22-d0f0bf743ce2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:26.196585 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-50c3fd23-4852-409c-ac22-d0f0bf743ce2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:26.197269 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-50c3fd23-4852-409c-ac22-d0f0bf743ce2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:26.197708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-50c3fd23-4852-409c-ac22-d0f0bf743ce2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:26.198116 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-50c3fd23-4852-409c-ac22-d0f0bf743ce2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:26.230653 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-50c3fd23-4852-409c-ac22-d0f0bf743ce2 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048484 Sep 13 07:11:26.231204 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 524/1012] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Sep 13 07:11:26 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 07:11:26.349914 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-cee32652-f96f-4769-a42f-e8b631e0727e tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:26.352216 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-cee32652-f96f-4769-a42f-e8b631e0727e tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:26.359093 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cee32652-f96f-4769-a42f-e8b631e0727e tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:26.359562 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cee32652-f96f-4769-a42f-e8b631e0727e tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:26.359994 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cee32652-f96f-4769-a42f-e8b631e0727e tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:26.360710 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cee32652-f96f-4769-a42f-e8b631e0727e tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:26.361147 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cee32652-f96f-4769-a42f-e8b631e0727e tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:26.361604 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cee32652-f96f-4769-a42f-e8b631e0727e tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:26.392573 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-cee32652-f96f-4769-a42f-e8b631e0727e tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047554 Sep 13 07:11:26.393117 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 489/1013] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Sep 13 07:11:26 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 07:11:26.468288 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-82f52266-5cb8-401a-881a-f206937d2ab0 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:26.468802 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-82f52266-5cb8-401a-881a-f206937d2ab0 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:26.475274 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82f52266-5cb8-401a-881a-f206937d2ab0 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:26.475753 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82f52266-5cb8-401a-881a-f206937d2ab0 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:26.476182 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82f52266-5cb8-401a-881a-f206937d2ab0 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:26.476860 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82f52266-5cb8-401a-881a-f206937d2ab0 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:26.477308 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82f52266-5cb8-401a-881a-f206937d2ab0 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:26.477722 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82f52266-5cb8-401a-881a-f206937d2ab0 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:26.503026 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-82f52266-5cb8-401a-881a-f206937d2ab0 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:11:26.589587 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-82f52266-5cb8-401a-881a-f206937d2ab0 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344" status: 204 len: 0 microversion: 2.1 time: 0.124799 Sep 13 07:11:26.590208 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 525/1014] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:11:26 2022] DELETE /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:11:26.600136 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-dd7283f9-c82d-4aae-a55d-2d187f08c680 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:26.600830 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-dd7283f9-c82d-4aae-a55d-2d187f08c680 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:26.608108 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dd7283f9-c82d-4aae-a55d-2d187f08c680 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:26.608590 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dd7283f9-c82d-4aae-a55d-2d187f08c680 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:26.609019 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dd7283f9-c82d-4aae-a55d-2d187f08c680 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:26.609933 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dd7283f9-c82d-4aae-a55d-2d187f08c680 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:26.610413 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dd7283f9-c82d-4aae-a55d-2d187f08c680 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:26.610836 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dd7283f9-c82d-4aae-a55d-2d187f08c680 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:26.762244 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-dd7283f9-c82d-4aae-a55d-2d187f08c680 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:11:26.770811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-dd7283f9-c82d-4aae-a55d-2d187f08c680 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344" status: 200 len: 1674 microversion: 2.1 time: 0.176060 Sep 13 07:11:26.771408 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 490/1015] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:11:26 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:11:27.799438 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8385e3d3-9544-4a58-bd85-efd255f4b9e1 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:27.800610 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8385e3d3-9544-4a58-bd85-efd255f4b9e1 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:27.815558 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8385e3d3-9544-4a58-bd85-efd255f4b9e1 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:27.816343 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8385e3d3-9544-4a58-bd85-efd255f4b9e1 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:27.816779 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8385e3d3-9544-4a58-bd85-efd255f4b9e1 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:27.818448 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8385e3d3-9544-4a58-bd85-efd255f4b9e1 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:27.818448 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8385e3d3-9544-4a58-bd85-efd255f4b9e1 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:27.818448 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8385e3d3-9544-4a58-bd85-efd255f4b9e1 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:27.964678 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8385e3d3-9544-4a58-bd85-efd255f4b9e1 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:11:27.973149 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8385e3d3-9544-4a58-bd85-efd255f4b9e1 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344" status: 200 len: 1674 microversion: 2.1 time: 0.180737 Sep 13 07:11:27.973766 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 526/1016] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:11:27 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 => generated 1674 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:11:29.007474 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-966876be-bda7-49b8-8cae-cae19c8e6744 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:29.008091 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-966876be-bda7-49b8-8cae-cae19c8e6744 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:29.015171 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-966876be-bda7-49b8-8cae-cae19c8e6744 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:29.015631 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-966876be-bda7-49b8-8cae-cae19c8e6744 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:29.016091 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-966876be-bda7-49b8-8cae-cae19c8e6744 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:29.016791 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-966876be-bda7-49b8-8cae-cae19c8e6744 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:29.017241 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-966876be-bda7-49b8-8cae-cae19c8e6744 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:29.017659 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-966876be-bda7-49b8-8cae-cae19c8e6744 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:29.267393 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-966876be-bda7-49b8-8cae-cae19c8e6744 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:11:29.275631 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-966876be-bda7-49b8-8cae-cae19c8e6744 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344" status: 200 len: 1674 microversion: 2.1 time: 0.272325 Sep 13 07:11:29.276433 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 491/1017] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:11:29 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 => generated 1674 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:11:29.650800 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-8f05b3a0-6013-4969-bd8a-2348d3d157fe req-8e2000b3-90d2-4afa-9fe8-05fb3ed05b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d47962b6-2a8d-498d-8ab5-213c713eb344", "name": "network-vif-deleted", "tag": "a01962be-937c-49e6-953b-c81b6d1f6bfc"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:11:29.662137 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8f05b3a0-6013-4969-bd8a-2348d3d157fe req-8e2000b3-90d2-4afa-9fe8-05fb3ed05b2c service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:29.663054 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8f05b3a0-6013-4969-bd8a-2348d3d157fe req-8e2000b3-90d2-4afa-9fe8-05fb3ed05b2c service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:29.663834 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8f05b3a0-6013-4969-bd8a-2348d3d157fe req-8e2000b3-90d2-4afa-9fe8-05fb3ed05b2c service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:29.678490 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-8f05b3a0-6013-4969-bd8a-2348d3d157fe req-8e2000b3-90d2-4afa-9fe8-05fb3ed05b2c service nova] Creating event network-vif-deleted:a01962be-937c-49e6-953b-c81b6d1f6bfc for instance d47962b6-2a8d-498d-8ab5-213c713eb344 on hv-cinder-85694 Sep 13 07:11:29.684027 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-8f05b3a0-6013-4969-bd8a-2348d3d157fe req-8e2000b3-90d2-4afa-9fe8-05fb3ed05b2c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036864 Sep 13 07:11:29.684637 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 527/1018] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:30.299711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d06408c4-2b7c-4974-b055-d12336576017 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:30.301254 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d06408c4-2b7c-4974-b055-d12336576017 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:30.308943 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d06408c4-2b7c-4974-b055-d12336576017 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:30.309693 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d06408c4-2b7c-4974-b055-d12336576017 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:30.310302 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d06408c4-2b7c-4974-b055-d12336576017 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:30.311246 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d06408c4-2b7c-4974-b055-d12336576017 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:30.311871 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d06408c4-2b7c-4974-b055-d12336576017 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:30.312517 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d06408c4-2b7c-4974-b055-d12336576017 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:30.350714 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d06408c4-2b7c-4974-b055-d12336576017 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:30.351302 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d06408c4-2b7c-4974-b055-d12336576017 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:30.351825 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d06408c4-2b7c-4974-b055-d12336576017 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:30.352343 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-d06408c4-2b7c-4974-b055-d12336576017 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lazy-loading 'fault' on Instance uuid d47962b6-2a8d-498d-8ab5-213c713eb344 {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:11:30.398490 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d06408c4-2b7c-4974-b055-d12336576017 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8576530b4ed4749a1e138f975d9b8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d19ffb32443babaa154c5766b6982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:11:30.405886 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d06408c4-2b7c-4974-b055-d12336576017 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344" status: 200 len: 1327 microversion: 2.1 time: 0.110555 Sep 13 07:11:30.406495 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 492/1019] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:11:30 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 => generated 1327 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:11:31.431615 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-48fcb3f7-a31e-456e-8397-648c1829aa5e tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:31.432348 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-48fcb3f7-a31e-456e-8397-648c1829aa5e tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:31.439172 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48fcb3f7-a31e-456e-8397-648c1829aa5e tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:31.439657 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48fcb3f7-a31e-456e-8397-648c1829aa5e tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:31.440098 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48fcb3f7-a31e-456e-8397-648c1829aa5e tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:31.440830 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48fcb3f7-a31e-456e-8397-648c1829aa5e tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:31.441314 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48fcb3f7-a31e-456e-8397-648c1829aa5e tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:31.441938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48fcb3f7-a31e-456e-8397-648c1829aa5e tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:31.456705 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-48fcb3f7-a31e-456e-8397-648c1829aa5e tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] HTTP exception thrown: Instance d47962b6-2a8d-498d-8ab5-213c713eb344 could not be found. Sep 13 07:11:31.458370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-48fcb3f7-a31e-456e-8397-648c1829aa5e tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Request method failure captured: Sep 13 07:11:31.458370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 HTTP/1.1 Sep 13 07:11:31.458370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:11:31.458370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:11:31.458370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:11:31.458370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:11:31.458370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:11:31.458370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:11:31.458370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:11:31.458370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:11:31.458370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICwRXHaLB3-EQWC43eGzybeFNOVO90FLZ8n2hx_2wnnotEdpnw2BnRvWHXRo8T6k_h3qaMk9UZ9FYtnDqnLkCq2r8mMJMJ1qHvn3WCEhSD2xSd0dOwRy9g0-jhla8rktopMvy3qWjhCXaLWzReBYAzMHKlDUPTU7ai66-9yj5xr4EGA Sep 13 07:11:31.458370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:11:31.458370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:11:31.458370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:11:31.458370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:11:31.458370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:11:31.458370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:11:31.458370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 0f2d19ffb32443babaa154c5766b6982 Sep 13 07:11:31.458370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeTestJSON-1423067582 Sep 13 07:11:31.458370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:11:31.458370 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:11:31.460079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f2d19ffb32443babaa154c5766b6982"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f2d19ffb32443babaa154c5766b6982"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f2d19ffb32443babaa154c5766b6982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f2d19ffb32443babaa154c5766b6982", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:11:31.460079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeTestJSON-1423067582 Sep 13 07:11:31.460079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 0f2d19ffb32443babaa154c5766b6982 Sep 13 07:11:31.460079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1423067582 Sep 13 07:11:31.460079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeTestJSON-1423067582-project Sep 13 07:11:31.460079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:11:31.460079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:11:31.460079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: a8576530b4ed4749a1e138f975d9b8b9 Sep 13 07:11:31.460079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeTestJSON-1423067582-project Sep 13 07:11:31.460079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:11:31.460079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance d47962b6-2a8d-498d-8ab5-213c713eb344 could not be found. Sep 13 07:11:31.460079 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': 'd47962b6-2a8d-498d-8ab5-213c713eb344'} Sep 13 07:11:31.461036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:11:31.461036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:31.461036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:11:31.461036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:11:31.461036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:11:31.461036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:11:31.461036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:11:31.461036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:11:31.461036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:11:31.461036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:11:31.461036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47962b6-2a8d-498d-8ab5-213c713eb344 could not be found. Sep 13 07:11:31.461036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:31.461036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:31.461036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:31.461036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:31.461036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:31.461036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:31.461036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:11:31.461036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:11:31.461036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:11:31.462723 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:11:31.462723 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:11:31.462723 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:11:31.462723 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:11:31.462723 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:11:31.462723 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:11:31.462723 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:11:31.462723 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47962b6-2a8d-498d-8ab5-213c713eb344 could not be found. Sep 13 07:11:31.462723 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:31.462723 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:31.462723 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:31.462723 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:31.462723 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:31.462723 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:31.462723 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:11:31.462723 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:11:31.462723 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47962b6-2a8d-498d-8ab5-213c713eb344 could not be found. Sep 13 07:11:31.462723 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:31.464165 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-48fcb3f7-a31e-456e-8397-648c1829aa5e tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Returning 404 to user: Instance d47962b6-2a8d-498d-8ab5-213c713eb344 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:11:31.464165 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-48fcb3f7-a31e-456e-8397-648c1829aa5e tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344" status: 404 len: 111 microversion: 2.1 time: 0.033376 Sep 13 07:11:31.464165 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 528/1020] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:11:31 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:11:31.469726 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ece8ea76-ddc6-4e43-b0fc-ddc7e67b48fd tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '.version_select at 0x7f4c19707820>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:31.491285 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ece8ea76-ddc6-4e43-b0fc-ddc7e67b48fd tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-174354146" status: 202 len: 0 microversion: 2.1 time: 0.026151 Sep 13 07:11:31.491872 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 493/1021] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Sep 13 07:11:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-174354146 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 07:11:34.437280 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ba6e6fbe-fa1f-4fbb-a5ec-dc7e80179b8b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:34.437855 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ba6e6fbe-fa1f-4fbb-a5ec-dc7e80179b8b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:34.440733 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:11:34.446850 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba6e6fbe-fa1f-4fbb-a5ec-dc7e80179b8b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:34.447325 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba6e6fbe-fa1f-4fbb-a5ec-dc7e80179b8b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:34.447764 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba6e6fbe-fa1f-4fbb-a5ec-dc7e80179b8b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:34.448455 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba6e6fbe-fa1f-4fbb-a5ec-dc7e80179b8b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:34.448911 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba6e6fbe-fa1f-4fbb-a5ec-dc7e80179b8b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:34.449337 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba6e6fbe-fa1f-4fbb-a5ec-dc7e80179b8b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:34.452446 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:11:34.465555 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-ba6e6fbe-fa1f-4fbb-a5ec-dc7e80179b8b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] HTTP exception thrown: Instance d47962b6-2a8d-498d-8ab5-213c713eb344 could not be found. Sep 13 07:11:34.467115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ba6e6fbe-fa1f-4fbb-a5ec-dc7e80179b8b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Request method failure captured: Sep 13 07:11:34.467115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 HTTP/1.1 Sep 13 07:11:34.467115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:11:34.467115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:11:34.467115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:11:34.467115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:11:34.467115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:11:34.467115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:11:34.467115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:11:34.467115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:11:34.467115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICwRXHaLB3-EQWC43eGzybeFNOVO90FLZ8n2hx_2wnnotEdpnw2BnRvWHXRo8T6k_h3qaMk9UZ9FYtnDqnLkCq2r8mMJMJ1qHvn3WCEhSD2xSd0dOwRy9g0-jhla8rktopMvy3qWjhCXaLWzReBYAzMHKlDUPTU7ai66-9yj5xr4EGA Sep 13 07:11:34.467115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:11:34.467115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:11:34.467115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:11:34.467115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:11:34.467115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:11:34.467115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:11:34.467115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 0f2d19ffb32443babaa154c5766b6982 Sep 13 07:11:34.467115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeTestJSON-1423067582 Sep 13 07:11:34.467115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:11:34.467115 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:11:34.468702 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f2d19ffb32443babaa154c5766b6982"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f2d19ffb32443babaa154c5766b6982"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f2d19ffb32443babaa154c5766b6982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f2d19ffb32443babaa154c5766b6982", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:11:34.468702 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeTestJSON-1423067582 Sep 13 07:11:34.468702 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 0f2d19ffb32443babaa154c5766b6982 Sep 13 07:11:34.468702 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1423067582 Sep 13 07:11:34.468702 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeTestJSON-1423067582-project Sep 13 07:11:34.468702 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:11:34.468702 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:11:34.468702 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: a8576530b4ed4749a1e138f975d9b8b9 Sep 13 07:11:34.468702 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeTestJSON-1423067582-project Sep 13 07:11:34.468702 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:11:34.468702 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance d47962b6-2a8d-498d-8ab5-213c713eb344 could not be found. Sep 13 07:11:34.468702 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': 'd47962b6-2a8d-498d-8ab5-213c713eb344'} Sep 13 07:11:34.469565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:11:34.469565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:34.469565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:11:34.469565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:11:34.469565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:11:34.469565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:11:34.469565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:11:34.469565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:11:34.469565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:11:34.469565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:11:34.469565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47962b6-2a8d-498d-8ab5-213c713eb344 could not be found. Sep 13 07:11:34.469565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:34.469565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:34.469565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:34.469565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:34.469565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:34.469565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:34.469565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:11:34.469565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:11:34.469565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:11:34.470938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:11:34.470938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 07:11:34.470938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 07:11:34.470938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 07:11:34.470938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 07:11:34.470938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:11:34.470938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:11:34.470938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:11:34.470938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:11:34.470938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47962b6-2a8d-498d-8ab5-213c713eb344 could not be found. Sep 13 07:11:34.470938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:34.470938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:34.470938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:34.470938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:34.470938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:34.470938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:34.470938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:11:34.470938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:11:34.470938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47962b6-2a8d-498d-8ab5-213c713eb344 could not be found. Sep 13 07:11:34.470938 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:34.472751 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ba6e6fbe-fa1f-4fbb-a5ec-dc7e80179b8b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Returning 404 to user: Instance d47962b6-2a8d-498d-8ab5-213c713eb344 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:11:34.472751 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ba6e6fbe-fa1f-4fbb-a5ec-dc7e80179b8b tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344" status: 404 len: 111 microversion: 2.1 time: 0.035198 Sep 13 07:11:34.472751 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 529/1022] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:11:34 2022] DELETE /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:11:34.478165 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-23e9818a-901b-4dcf-b845-32fe38139fcc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:34.478773 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-23e9818a-901b-4dcf-b845-32fe38139fcc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: d47962b6-2a8d-498d-8ab5-213c713eb344] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:34.485733 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23e9818a-901b-4dcf-b845-32fe38139fcc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:34.486247 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23e9818a-901b-4dcf-b845-32fe38139fcc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:34.486679 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23e9818a-901b-4dcf-b845-32fe38139fcc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:34.487376 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23e9818a-901b-4dcf-b845-32fe38139fcc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:34.487829 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23e9818a-901b-4dcf-b845-32fe38139fcc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:34.488246 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23e9818a-901b-4dcf-b845-32fe38139fcc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:34.501602 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-23e9818a-901b-4dcf-b845-32fe38139fcc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] HTTP exception thrown: Instance d47962b6-2a8d-498d-8ab5-213c713eb344 could not be found. Sep 13 07:11:34.503278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-23e9818a-901b-4dcf-b845-32fe38139fcc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Request method failure captured: Sep 13 07:11:34.503278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 HTTP/1.1 Sep 13 07:11:34.503278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:11:34.503278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:11:34.503278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:11:34.503278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:11:34.503278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:11:34.503278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:11:34.503278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:11:34.503278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:11:34.503278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICwRXHaLB3-EQWC43eGzybeFNOVO90FLZ8n2hx_2wnnotEdpnw2BnRvWHXRo8T6k_h3qaMk9UZ9FYtnDqnLkCq2r8mMJMJ1qHvn3WCEhSD2xSd0dOwRy9g0-jhla8rktopMvy3qWjhCXaLWzReBYAzMHKlDUPTU7ai66-9yj5xr4EGA Sep 13 07:11:34.503278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:11:34.503278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:11:34.503278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:11:34.503278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:11:34.503278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:11:34.503278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:11:34.503278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: 0f2d19ffb32443babaa154c5766b6982 Sep 13 07:11:34.503278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeTestJSON-1423067582 Sep 13 07:11:34.503278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:11:34.503278 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:11:34.504938 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f2d19ffb32443babaa154c5766b6982"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f2d19ffb32443babaa154c5766b6982"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f2d19ffb32443babaa154c5766b6982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f2d19ffb32443babaa154c5766b6982", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:11:34.504938 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeTestJSON-1423067582 Sep 13 07:11:34.504938 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 0f2d19ffb32443babaa154c5766b6982 Sep 13 07:11:34.504938 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1423067582 Sep 13 07:11:34.504938 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeTestJSON-1423067582-project Sep 13 07:11:34.504938 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:11:34.504938 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:11:34.504938 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: a8576530b4ed4749a1e138f975d9b8b9 Sep 13 07:11:34.504938 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeTestJSON-1423067582-project Sep 13 07:11:34.504938 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:11:34.504938 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Instance d47962b6-2a8d-498d-8ab5-213c713eb344 could not be found. Sep 13 07:11:34.504938 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': 'd47962b6-2a8d-498d-8ab5-213c713eb344'} Sep 13 07:11:34.506177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:11:34.506177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:34.506177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:11:34.506177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:11:34.506177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:11:34.506177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:11:34.506177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:11:34.506177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:11:34.506177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:11:34.506177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:11:34.506177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47962b6-2a8d-498d-8ab5-213c713eb344 could not be found. Sep 13 07:11:34.506177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:34.506177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:34.506177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:34.506177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:34.506177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:34.506177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:34.506177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:11:34.506177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:11:34.506177 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:11:34.508595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:11:34.508595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:11:34.508595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:11:34.508595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:11:34.508595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:11:34.508595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:11:34.508595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:11:34.508595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47962b6-2a8d-498d-8ab5-213c713eb344 could not be found. Sep 13 07:11:34.508595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:34.508595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:34.508595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:34.508595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:34.508595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:34.508595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:34.508595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:11:34.508595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:11:34.508595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47962b6-2a8d-498d-8ab5-213c713eb344 could not be found. Sep 13 07:11:34.508595 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:34.510016 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-23e9818a-901b-4dcf-b845-32fe38139fcc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Returning 404 to user: Instance d47962b6-2a8d-498d-8ab5-213c713eb344 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:11:34.510016 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-23e9818a-901b-4dcf-b845-32fe38139fcc tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344" status: 404 len: 111 microversion: 2.1 time: 0.031493 Sep 13 07:11:34.510016 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 494/1023] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:11:34 2022] GET /compute/v2.1/servers/d47962b6-2a8d-498d-8ab5-213c713eb344 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:11:35.665187 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-53de4906-92ec-42be-a153-a70f9d9767e9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:35.665734 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-53de4906-92ec-42be-a153-a70f9d9767e9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:35.672741 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-53de4906-92ec-42be-a153-a70f9d9767e9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:35.673232 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-53de4906-92ec-42be-a153-a70f9d9767e9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:35.673665 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-53de4906-92ec-42be-a153-a70f9d9767e9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:35.674413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-53de4906-92ec-42be-a153-a70f9d9767e9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:35.674867 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-53de4906-92ec-42be-a153-a70f9d9767e9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:35.675287 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-53de4906-92ec-42be-a153-a70f9d9767e9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:35.689683 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-53de4906-92ec-42be-a153-a70f9d9767e9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] HTTP exception thrown: Instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 could not be found. Sep 13 07:11:35.691408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-53de4906-92ec-42be-a153-a70f9d9767e9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Request method failure captured: Sep 13 07:11:35.691408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 HTTP/1.1 Sep 13 07:11:35.691408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:11:35.691408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:11:35.691408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:11:35.691408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:11:35.691408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:11:35.691408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:11:35.691408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:11:35.691408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:11:35.691408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICwRXHaLB3-EQWC43eGzybeFNOVO90FLZ8n2hx_2wnnotEdpnw2BnRvWHXRo8T6k_h3qaMk9UZ9FYtnDqnLkCq2r8mMJMJ1qHvn3WCEhSD2xSd0dOwRy9g0-jhla8rktopMvy3qWjhCXaLWzReBYAzMHKlDUPTU7ai66-9yj5xr4EGA Sep 13 07:11:35.691408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:11:35.691408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:11:35.691408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:11:35.691408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:11:35.691408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:11:35.691408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:11:35.691408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 0f2d19ffb32443babaa154c5766b6982 Sep 13 07:11:35.691408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeTestJSON-1423067582 Sep 13 07:11:35.691408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:11:35.691408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:11:35.692971 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f2d19ffb32443babaa154c5766b6982"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f2d19ffb32443babaa154c5766b6982"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f2d19ffb32443babaa154c5766b6982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f2d19ffb32443babaa154c5766b6982", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:11:35.692971 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeTestJSON-1423067582 Sep 13 07:11:35.692971 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 0f2d19ffb32443babaa154c5766b6982 Sep 13 07:11:35.692971 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1423067582 Sep 13 07:11:35.692971 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeTestJSON-1423067582-project Sep 13 07:11:35.692971 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:11:35.692971 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:11:35.692971 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: a8576530b4ed4749a1e138f975d9b8b9 Sep 13 07:11:35.692971 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeTestJSON-1423067582-project Sep 13 07:11:35.692971 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:11:35.692971 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 could not be found. Sep 13 07:11:35.692971 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': '14d8a213-41c7-497e-a6a1-82dea1b238d7'} Sep 13 07:11:35.694708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:11:35.694708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:35.694708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:11:35.694708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:11:35.694708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:11:35.694708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:11:35.694708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:11:35.694708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:11:35.694708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:11:35.694708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:11:35.694708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 could not be found. Sep 13 07:11:35.694708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:35.694708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:35.694708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:35.694708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:35.694708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:35.694708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:35.694708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:11:35.694708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:11:35.694708 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:11:35.696267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:11:35.696267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 07:11:35.696267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 07:11:35.696267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 07:11:35.696267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 07:11:35.696267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:11:35.696267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:11:35.696267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:11:35.696267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:11:35.696267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 could not be found. Sep 13 07:11:35.696267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:35.696267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:35.696267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:35.696267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:35.696267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:35.696267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:35.696267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:11:35.696267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:11:35.696267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 could not be found. Sep 13 07:11:35.696267 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:35.697901 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-53de4906-92ec-42be-a153-a70f9d9767e9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Returning 404 to user: Instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:11:35.697901 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-53de4906-92ec-42be-a153-a70f9d9767e9 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "DELETE /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 404 len: 111 microversion: 2.1 time: 0.032111 Sep 13 07:11:35.697901 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 530/1024] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:11:35 2022] DELETE /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:11:35.703639 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6506dd77-37ec-46ea-9939-35c94142f105 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:35.704263 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6506dd77-37ec-46ea-9939-35c94142f105 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] [instance: 14d8a213-41c7-497e-a6a1-82dea1b238d7] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:35.706766 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:11:35.712670 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6506dd77-37ec-46ea-9939-35c94142f105 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:35.713158 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6506dd77-37ec-46ea-9939-35c94142f105 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:35.713589 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6506dd77-37ec-46ea-9939-35c94142f105 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:35.714328 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6506dd77-37ec-46ea-9939-35c94142f105 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:35.714776 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6506dd77-37ec-46ea-9939-35c94142f105 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:35.715198 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6506dd77-37ec-46ea-9939-35c94142f105 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:35.718598 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:11:35.732186 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-6506dd77-37ec-46ea-9939-35c94142f105 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] HTTP exception thrown: Instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 could not be found. Sep 13 07:11:35.734045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6506dd77-37ec-46ea-9939-35c94142f105 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Request method failure captured: Sep 13 07:11:35.734045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 HTTP/1.1 Sep 13 07:11:35.734045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:11:35.734045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:11:35.734045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:11:35.734045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:11:35.734045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:11:35.734045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:11:35.734045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:11:35.734045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:11:35.734045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICwRXHaLB3-EQWC43eGzybeFNOVO90FLZ8n2hx_2wnnotEdpnw2BnRvWHXRo8T6k_h3qaMk9UZ9FYtnDqnLkCq2r8mMJMJ1qHvn3WCEhSD2xSd0dOwRy9g0-jhla8rktopMvy3qWjhCXaLWzReBYAzMHKlDUPTU7ai66-9yj5xr4EGA Sep 13 07:11:35.734045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:11:35.734045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:11:35.734045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:11:35.734045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:11:35.734045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:11:35.734045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:11:35.734045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: 0f2d19ffb32443babaa154c5766b6982 Sep 13 07:11:35.734045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeTestJSON-1423067582 Sep 13 07:11:35.734045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:11:35.734045 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:11:35.735779 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f2d19ffb32443babaa154c5766b6982"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f2d19ffb32443babaa154c5766b6982"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f2d19ffb32443babaa154c5766b6982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f2d19ffb32443babaa154c5766b6982", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:11:35.735779 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeTestJSON-1423067582 Sep 13 07:11:35.735779 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 0f2d19ffb32443babaa154c5766b6982 Sep 13 07:11:35.735779 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1423067582 Sep 13 07:11:35.735779 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeTestJSON-1423067582-project Sep 13 07:11:35.735779 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:11:35.735779 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:11:35.735779 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: a8576530b4ed4749a1e138f975d9b8b9 Sep 13 07:11:35.735779 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeTestJSON-1423067582-project Sep 13 07:11:35.735779 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:11:35.735779 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 could not be found. Sep 13 07:11:35.735779 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': '14d8a213-41c7-497e-a6a1-82dea1b238d7'} Sep 13 07:11:35.736819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:11:35.736819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:35.736819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:11:35.736819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:11:35.736819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:11:35.736819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:11:35.736819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:11:35.736819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:11:35.736819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:11:35.736819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:11:35.736819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 could not be found. Sep 13 07:11:35.736819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:35.736819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:35.736819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:35.736819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:35.736819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:35.736819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:35.736819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:11:35.736819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:11:35.736819 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:11:35.738434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:11:35.738434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:11:35.738434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:11:35.738434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:11:35.738434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:11:35.738434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:11:35.738434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:11:35.738434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 could not be found. Sep 13 07:11:35.738434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:35.738434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:35.738434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:35.738434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:35.738434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:35.738434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:35.738434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:11:35.738434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:11:35.738434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 could not be found. Sep 13 07:11:35.738434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:35.739997 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6506dd77-37ec-46ea-9939-35c94142f105 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] Returning 404 to user: Instance 14d8a213-41c7-497e-a6a1-82dea1b238d7 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:11:35.739997 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6506dd77-37ec-46ea-9939-35c94142f105 tempest-AttachVolumeTestJSON-1423067582 tempest-AttachVolumeTestJSON-1423067582-project] 10.222.0.25 "GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7" status: 404 len: 111 microversion: 2.1 time: 0.036196 Sep 13 07:11:35.739997 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 495/1025] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:11:35 2022] GET /compute/v2.1/servers/14d8a213-41c7-497e-a6a1-82dea1b238d7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:11:40.199004 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-016f6de4-19eb-4334-a422-e89db16ad2e0 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Action: 'create', calling method: .version_select at 0x7f4c195c0040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1560062048"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:11:40.513877 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-016f6de4-19eb-4334-a422-e89db16ad2e0 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.438527 Sep 13 07:11:40.514433 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 531/1026] 10.222.0.25 () {60 vars in 1155 bytes} [Tue Sep 13 07:11:40 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 440 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 07:11:40.528711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-dab5f7df-78be-4bbe-b9dc-45cf86ed0b24 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Calling method '.version_select at 0x7f4c19b1bca0>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:40.582692 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-dab5f7df-78be-4bbe-b9dc-45cf86ed0b24 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/89e34b45-a912-452e-bf20-d53f2388d96c" status: 200 len: 345 microversion: 2.1 time: 0.057793 Sep 13 07:11:40.583398 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 496/1027] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Sep 13 07:11:40 2022] GET /compute/v2.1/os-volumes/89e34b45-a912-452e-bf20-d53f2388d96c => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:40.923440 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-332928f4-28b7-4be3-bbf5-464f4e248b1f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:40.924036 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-332928f4-28b7-4be3-bbf5-464f4e248b1f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:40.925441 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-7a043958-e9eb-4048-82d5-0984cc83c4c2 req-3178bc09-4c35-4e46-8103-a8562ca6025c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e083757-8d71-44e3-a1c7-adca051e9296", "tag": "7ac4efce-383d-4358-82c8-5099b44c4a3d"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:11:40.932703 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-332928f4-28b7-4be3-bbf5-464f4e248b1f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:40.933346 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-332928f4-28b7-4be3-bbf5-464f4e248b1f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:40.933944 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-332928f4-28b7-4be3-bbf5-464f4e248b1f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:40.934796 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-332928f4-28b7-4be3-bbf5-464f4e248b1f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:40.935317 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-332928f4-28b7-4be3-bbf5-464f4e248b1f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:40.935829 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-332928f4-28b7-4be3-bbf5-464f4e248b1f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:40.936468 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-7a043958-e9eb-4048-82d5-0984cc83c4c2 req-3178bc09-4c35-4e46-8103-a8562ca6025c service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:40.937141 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-7a043958-e9eb-4048-82d5-0984cc83c4c2 req-3178bc09-4c35-4e46-8103-a8562ca6025c service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:40.937554 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-7a043958-e9eb-4048-82d5-0984cc83c4c2 req-3178bc09-4c35-4e46-8103-a8562ca6025c service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:40.950112 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-7a043958-e9eb-4048-82d5-0984cc83c4c2 req-3178bc09-4c35-4e46-8103-a8562ca6025c service nova] Creating event network-changed:7ac4efce-383d-4358-82c8-5099b44c4a3d for instance 7e083757-8d71-44e3-a1c7-adca051e9296 on hv-cinder-85694 Sep 13 07:11:40.955611 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-7a043958-e9eb-4048-82d5-0984cc83c4c2 req-3178bc09-4c35-4e46-8103-a8562ca6025c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033954 Sep 13 07:11:40.956601 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 497/1028] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:11:40.964063 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-332928f4-28b7-4be3-bbf5-464f4e248b1f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:11:41.059323 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-332928f4-28b7-4be3-bbf5-464f4e248b1f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 204 len: 0 microversion: 2.1 time: 0.138861 Sep 13 07:11:41.063023 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 532/1029] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:11:40 2022] DELETE /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:11:41.068856 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d68d6147-bbdb-446b-9887-9a1a08654ec5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:41.070400 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d68d6147-bbdb-446b-9887-9a1a08654ec5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:41.076749 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d68d6147-bbdb-446b-9887-9a1a08654ec5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:41.077429 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d68d6147-bbdb-446b-9887-9a1a08654ec5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:41.078056 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d68d6147-bbdb-446b-9887-9a1a08654ec5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:41.078928 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d68d6147-bbdb-446b-9887-9a1a08654ec5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:41.079534 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d68d6147-bbdb-446b-9887-9a1a08654ec5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:41.080173 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d68d6147-bbdb-446b-9887-9a1a08654ec5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:41.250025 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d68d6147-bbdb-446b-9887-9a1a08654ec5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:11:41.258370 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d68d6147-bbdb-446b-9887-9a1a08654ec5 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 200 len: 1578 microversion: 2.1 time: 0.193823 Sep 13 07:11:41.259065 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 498/1030] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:11:41 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 1578 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:11:41.597651 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a9b5b72d-c8f9-4204-8aca-5ea303733d55 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Calling method '.version_select at 0x7f4c19488940>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:41.647872 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a9b5b72d-c8f9-4204-8aca-5ea303733d55 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/89e34b45-a912-452e-bf20-d53f2388d96c" status: 200 len: 346 microversion: 2.1 time: 0.054356 Sep 13 07:11:41.648445 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 533/1031] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Sep 13 07:11:41 2022] GET /compute/v2.1/os-volumes/89e34b45-a912-452e-bf20-d53f2388d96c => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:41.661588 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-40b172d5-9fc4-4c2d-afe6-b414c57242c1 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Action: 'create', calling method: .version_select at 0x7f4c1964ed30>, body: {"snapshot": {"volume_id": "89e34b45-a912-452e-bf20-d53f2388d96c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-897626686"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:11:41.829331 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-40b172d5-9fc4-4c2d-afe6-b414c57242c1 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.171654 Sep 13 07:11:41.830001 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 499/1032] 10.222.0.25 () {60 vars in 1162 bytes} [Tue Sep 13 07:11:41 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:41.842041 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-36e0b8e9-5193-4a20-9ed6-1b809e625523 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Calling method '.version_select at 0x7f4c196be280>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:41.878274 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-36e0b8e9-5193-4a20-9ed6-1b809e625523 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7" status: 200 len: 286 microversion: 2.1 time: 0.040887 Sep 13 07:11:41.878947 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 534/1033] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Sep 13 07:11:41 2022] GET /compute/v2.1/os-snapshots/775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:11:41.890476 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a849b0ce-cfb5-4625-bbb7-70430f33d04b tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Calling method '.version_select at 0x7f4c1959ae50>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:41.923593 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a849b0ce-cfb5-4625-bbb7-70430f33d04b tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.037148 Sep 13 07:11:41.924167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 500/1034] 10.222.0.25 () {58 vars in 1140 bytes} [Tue Sep 13 07:11:41 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:41.935818 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-557a045e-f169-4b4a-97ae-46c4858fc94e tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Calling method '.version_select at 0x7f4c1947d550>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:41.967026 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-557a045e-f169-4b4a-97ae-46c4858fc94e tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7" status: 200 len: 286 microversion: 2.1 time: 0.035004 Sep 13 07:11:41.967592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 535/1035] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Sep 13 07:11:41 2022] GET /compute/v2.1/os-snapshots/775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:11:42.285987 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-84943a3c-4794-468c-902e-d65d59ca02a7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:42.287039 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-84943a3c-4794-468c-902e-d65d59ca02a7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:42.297474 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84943a3c-4794-468c-902e-d65d59ca02a7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:42.298276 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84943a3c-4794-468c-902e-d65d59ca02a7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:42.298993 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84943a3c-4794-468c-902e-d65d59ca02a7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:42.300128 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84943a3c-4794-468c-902e-d65d59ca02a7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:42.300875 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84943a3c-4794-468c-902e-d65d59ca02a7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:42.301578 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84943a3c-4794-468c-902e-d65d59ca02a7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:42.462613 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-84943a3c-4794-468c-902e-d65d59ca02a7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:11:42.470659 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-84943a3c-4794-468c-902e-d65d59ca02a7 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 200 len: 1578 microversion: 2.1 time: 0.191166 Sep 13 07:11:42.471225 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 501/1036] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:11:42 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 1578 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:11:42.984840 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ab46a08d-d2c8-4d8c-9222-caa2e866ac6e tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Calling method '.version_select at 0x7f4c19543c10>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:43.017592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ab46a08d-d2c8-4d8c-9222-caa2e866ac6e tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7" status: 200 len: 286 microversion: 2.1 time: 0.039961 Sep 13 07:11:43.018184 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 536/1037] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Sep 13 07:11:42 2022] GET /compute/v2.1/os-snapshots/775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:43.498381 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-76a219ad-3d64-4e5d-8169-2411d1c7b757 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:43.499404 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-76a219ad-3d64-4e5d-8169-2411d1c7b757 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:43.509113 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-76a219ad-3d64-4e5d-8169-2411d1c7b757 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:43.509601 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-76a219ad-3d64-4e5d-8169-2411d1c7b757 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:43.510038 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-76a219ad-3d64-4e5d-8169-2411d1c7b757 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:43.510780 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-76a219ad-3d64-4e5d-8169-2411d1c7b757 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:43.511250 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-76a219ad-3d64-4e5d-8169-2411d1c7b757 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:43.511650 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-76a219ad-3d64-4e5d-8169-2411d1c7b757 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:43.645134 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-76a219ad-3d64-4e5d-8169-2411d1c7b757 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:11:43.653068 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-76a219ad-3d64-4e5d-8169-2411d1c7b757 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 200 len: 1578 microversion: 2.1 time: 0.161243 Sep 13 07:11:43.653647 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 502/1038] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:11:43 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:11:44.032814 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0cf4c498-ce0e-4ce0-9c75-9e9511cdd012 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Calling method '.version_select at 0x7f4c19489040>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:44.066390 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0cf4c498-ce0e-4ce0-9c75-9e9511cdd012 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7" status: 200 len: 286 microversion: 2.1 time: 0.038728 Sep 13 07:11:44.066944 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 537/1039] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Sep 13 07:11:44 2022] GET /compute/v2.1/os-snapshots/775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:44.676762 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0d43584a-fbaf-45a9-8baa-5b12548a640a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:44.677376 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0d43584a-fbaf-45a9-8baa-5b12548a640a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:44.685030 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d43584a-fbaf-45a9-8baa-5b12548a640a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:44.685526 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d43584a-fbaf-45a9-8baa-5b12548a640a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:44.685984 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d43584a-fbaf-45a9-8baa-5b12548a640a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:44.686724 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d43584a-fbaf-45a9-8baa-5b12548a640a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:44.687179 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d43584a-fbaf-45a9-8baa-5b12548a640a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:44.687605 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d43584a-fbaf-45a9-8baa-5b12548a640a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:44.894296 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0d43584a-fbaf-45a9-8baa-5b12548a640a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:11:44.907407 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0d43584a-fbaf-45a9-8baa-5b12548a640a tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 200 len: 1578 microversion: 2.1 time: 0.234310 Sep 13 07:11:44.908201 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 503/1040] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:11:44 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 1578 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:11:45.081447 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-70c8493c-47e1-4cea-bb7b-35c806eb83e6 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Calling method '.version_select at 0x7f4c1985a310>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:45.115709 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-70c8493c-47e1-4cea-bb7b-35c806eb83e6 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7" status: 200 len: 287 microversion: 2.1 time: 0.039520 Sep 13 07:11:45.116271 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 538/1041] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Sep 13 07:11:45 2022] GET /compute/v2.1/os-snapshots/775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:45.127858 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-cdad0a60-6825-462b-9f76-486ba6388df2 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Calling method '.version_select at 0x7f4c19605790>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:45.192724 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-cdad0a60-6825-462b-9f76-486ba6388df2 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7" status: 202 len: 0 microversion: 2.1 time: 0.068752 Sep 13 07:11:45.193306 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 504/1042] 10.222.0.25 () {58 vars in 1254 bytes} [Tue Sep 13 07:11:45 2022] DELETE /compute/v2.1/os-snapshots/775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:11:45.202271 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6ff76c6f-6c5a-4400-8e8b-3714c1902180 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Calling method '.version_select at 0x7f4c1947ddc0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:45.233421 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6ff76c6f-6c5a-4400-8e8b-3714c1902180 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7" status: 200 len: 286 microversion: 2.1 time: 0.035392 Sep 13 07:11:45.233994 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 539/1043] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Sep 13 07:11:45 2022] GET /compute/v2.1/os-snapshots/775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:45.904848 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-56d381f6-d880-4ed8-ab95-d3c70cc4424b req-defe0dbe-d4d5-4c9a-a076-62251ddbd5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e083757-8d71-44e3-a1c7-adca051e9296", "name": "network-vif-deleted", "tag": "7ac4efce-383d-4358-82c8-5099b44c4a3d"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:11:45.915428 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-56d381f6-d880-4ed8-ab95-d3c70cc4424b req-defe0dbe-d4d5-4c9a-a076-62251ddbd5a6 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:45.915895 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-56d381f6-d880-4ed8-ab95-d3c70cc4424b req-defe0dbe-d4d5-4c9a-a076-62251ddbd5a6 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:45.916311 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-56d381f6-d880-4ed8-ab95-d3c70cc4424b req-defe0dbe-d4d5-4c9a-a076-62251ddbd5a6 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:45.927073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-56d381f6-d880-4ed8-ab95-d3c70cc4424b req-defe0dbe-d4d5-4c9a-a076-62251ddbd5a6 service nova] Creating event network-vif-deleted:7ac4efce-383d-4358-82c8-5099b44c4a3d for instance 7e083757-8d71-44e3-a1c7-adca051e9296 on hv-cinder-85694 Sep 13 07:11:45.932277 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4ffe9b3d-05ef-4a0f-bc06-278c8858e7ca tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:45.932823 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-56d381f6-d880-4ed8-ab95-d3c70cc4424b req-defe0dbe-d4d5-4c9a-a076-62251ddbd5a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031917 Sep 13 07:11:45.933230 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 505/1044] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:45.933703 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4ffe9b3d-05ef-4a0f-bc06-278c8858e7ca tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:45.941765 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ffe9b3d-05ef-4a0f-bc06-278c8858e7ca tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:45.942284 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ffe9b3d-05ef-4a0f-bc06-278c8858e7ca tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:45.942716 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ffe9b3d-05ef-4a0f-bc06-278c8858e7ca tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:45.943440 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ffe9b3d-05ef-4a0f-bc06-278c8858e7ca tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:45.943878 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ffe9b3d-05ef-4a0f-bc06-278c8858e7ca tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:45.944289 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ffe9b3d-05ef-4a0f-bc06-278c8858e7ca tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:46.011397 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4ffe9b3d-05ef-4a0f-bc06-278c8858e7ca tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:11:46.019427 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4ffe9b3d-05ef-4a0f-bc06-278c8858e7ca tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 200 len: 1225 microversion: 2.1 time: 0.092581 Sep 13 07:11:46.019986 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 540/1045] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:11:45 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:11:46.247791 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a168b386-35a6-42f9-ba51-7b02dcccd405 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Calling method '.version_select at 0x7f4c1966ed30>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:46.275826 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-a168b386-35a6-42f9-ba51-7b02dcccd405 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] HTTP exception thrown: Snapshot 775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7 could not be found. Sep 13 07:11:46.281289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a168b386-35a6-42f9-ba51-7b02dcccd405 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Request method failure captured: Sep 13 07:11:46.281289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/os-snapshots/775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7 HTTP/1.1 Sep 13 07:11:46.281289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:11:46.281289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:11:46.281289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:11:46.281289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:11:46.281289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:11:46.281289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:11:46.281289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:11:46.281289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:11:46.281289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjIC0r4t6HyiBp-4_3kHCzGll166nLAbQVOvHMXq_OgxaaD_df0lXODq9Z5i_cytmfjfIJ-s8qG2Moosqk8QlRPp_kb67SPKALqJ_lDp1lq3B45pskfBgEbpydTagMgh589ZXBNvPBjr9ZobsUJI-meIxSRg23ve2yMh27m3X88nbpjX4 Sep 13 07:11:46.281289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:11:46.281289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:11:46.281289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:11:46.281289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:11:46.281289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:11:46.281289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:11:46.281289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: c256c5ce95db432b850fd7c7392ac214 Sep 13 07:11:46.281289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1442828287 Sep 13 07:11:46.281289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:11:46.281289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:11:46.283167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c256c5ce95db432b850fd7c7392ac214"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c256c5ce95db432b850fd7c7392ac214"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c256c5ce95db432b850fd7c7392ac214"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c256c5ce95db432b850fd7c7392ac214", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:11:46.283167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1442828287 Sep 13 07:11:46.283167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: c256c5ce95db432b850fd7c7392ac214 Sep 13 07:11:46.283167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1442828287 Sep 13 07:11:46.283167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-VolumesSnapshotsTestJSON-1442828287-project Sep 13 07:11:46.283167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:11:46.283167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:11:46.283167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: bbebe495e6da4c80b5c8ffa30069d4e3 Sep 13 07:11:46.283167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1442828287-project Sep 13 07:11:46.283167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: Sep 13 07:11:46.283167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Snapshot 775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7 could not be found. Sep 13 07:11:46.283167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': '775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7'} Sep 13 07:11:46.283167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:11:46.284145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:46.284145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 07:11:46.284145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 07:11:46.284145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 07:11:46.284145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 07:11:46.284145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 07:11:46.284145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 07:11:46.284145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 07:11:46.284145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 07:11:46.284145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 07:11:46.284145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 07:11:46.284145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:11:46.284145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:11:46.284145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:11:46.284145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:11:46.284145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7 could not be found. (HTTP 404) (Request-ID: req-ddc34985-4c7d-4c2d-a19c-0743b359b04d) Sep 13 07:11:46.284145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:46.284145 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:46.285385 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:46.285385 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:46.285385 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 13 07:11:46.285385 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 13 07:11:46.285385 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 07:11:46.285385 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 07:11:46.285385 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 13 07:11:46.285385 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 13 07:11:46.285385 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 07:11:46.285385 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 07:11:46.285385 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 07:11:46.285385 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 07:11:46.285385 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 07:11:46.285385 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 07:11:46.285385 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 07:11:46.285385 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 07:11:46.285385 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 07:11:46.285385 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 07:11:46.285385 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 07:11:46.286708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 07:11:46.286708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:11:46.286708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:11:46.286708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:11:46.286708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:11:46.286708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7 could not be found. Sep 13 07:11:46.286708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:46.286708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:46.286708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:46.286708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:46.286708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:46.286708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:46.286708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:11:46.286708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:11:46.286708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 07:11:46.286708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 07:11:46.286708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:11:46.286708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:11:46.286708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 13 07:11:46.286708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:11:46.288190 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7 could not be found. Sep 13 07:11:46.288190 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:46.288190 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:46.288190 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:46.288190 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:46.288190 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:46.288190 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:46.288190 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:11:46.288190 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:11:46.288190 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7 could not be found. Sep 13 07:11:46.288190 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:46.288190 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a168b386-35a6-42f9-ba51-7b02dcccd405 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Returning 404 to user: Snapshot 775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:11:46.288190 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a168b386-35a6-42f9-ba51-7b02dcccd405 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7" status: 404 len: 111 microversion: 2.1 time: 0.039550 Sep 13 07:11:46.289214 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 506/1046] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Sep 13 07:11:46 2022] GET /compute/v2.1/os-snapshots/775f8fa0-d6a6-4f0a-baf2-e24f2a542fc7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:11:46.291988 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d9fbd96c-27e1-4781-862e-6297106dca3b tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Calling method '.version_select at 0x7f4c1985a700>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:46.359608 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d9fbd96c-27e1-4781-862e-6297106dca3b tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/89e34b45-a912-452e-bf20-d53f2388d96c" status: 202 len: 0 microversion: 2.1 time: 0.071618 Sep 13 07:11:46.360140 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 541/1047] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Sep 13 07:11:46 2022] DELETE /compute/v2.1/os-volumes/89e34b45-a912-452e-bf20-d53f2388d96c => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 07:11:46.369345 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c97fd662-e9c2-40ba-9ab4-c6f768aac7d3 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Calling method '.version_select at 0x7f4c19670040>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:46.422718 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c97fd662-e9c2-40ba-9ab4-c6f768aac7d3 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/89e34b45-a912-452e-bf20-d53f2388d96c" status: 200 len: 345 microversion: 2.1 time: 0.058006 Sep 13 07:11:46.423298 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 507/1048] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Sep 13 07:11:46 2022] GET /compute/v2.1/os-volumes/89e34b45-a912-452e-bf20-d53f2388d96c => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:47.043471 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0afffc52-ca0a-4c7c-acf7-fb1541a7d4d1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:47.044048 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0afffc52-ca0a-4c7c-acf7-fb1541a7d4d1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: 7e083757-8d71-44e3-a1c7-adca051e9296] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:47.051376 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0afffc52-ca0a-4c7c-acf7-fb1541a7d4d1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:47.051912 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0afffc52-ca0a-4c7c-acf7-fb1541a7d4d1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:47.052389 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0afffc52-ca0a-4c7c-acf7-fb1541a7d4d1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:47.053156 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0afffc52-ca0a-4c7c-acf7-fb1541a7d4d1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:47.053656 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0afffc52-ca0a-4c7c-acf7-fb1541a7d4d1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:47.054120 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0afffc52-ca0a-4c7c-acf7-fb1541a7d4d1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:47.068797 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-0afffc52-ca0a-4c7c-acf7-fb1541a7d4d1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] HTTP exception thrown: Instance 7e083757-8d71-44e3-a1c7-adca051e9296 could not be found. Sep 13 07:11:47.070573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0afffc52-ca0a-4c7c-acf7-fb1541a7d4d1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Request method failure captured: Sep 13 07:11:47.070573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 HTTP/1.1 Sep 13 07:11:47.070573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:11:47.070573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:11:47.070573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:11:47.070573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:11:47.070573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:11:47.070573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:11:47.070573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:11:47.070573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:11:47.070573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICt9Lj4_bEAvQVyFr7NuHfrDtiIH3Txfam13pusmwJ6IKF3fVnHbtRtJ8nNxQs_hOFQZdK7LzDouqsp2xWTr2w88N3LQTnQ6Hx_rWq7NNmCxdEIAAANuK_3kHmkwcI5QDGrO9eDBylk8h3swDl36x9AlTa1aIeGwA8hiQzjgxEjU56g Sep 13 07:11:47.070573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:11:47.070573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:11:47.070573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:11:47.070573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:11:47.070573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:11:47.070573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:11:47.070573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 99bbe5cbd59f4feda4da45f2b14bd09b Sep 13 07:11:47.070573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-TestVolumeBootPattern-2077651277 Sep 13 07:11:47.070573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:11:47.070573 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:11:47.072924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/99bbe5cbd59f4feda4da45f2b14bd09b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bbe5cbd59f4feda4da45f2b14bd09b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bbe5cbd59f4feda4da45f2b14bd09b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_99bbe5cbd59f4feda4da45f2b14bd09b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:11:47.072924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-TestVolumeBootPattern-2077651277 Sep 13 07:11:47.072924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 99bbe5cbd59f4feda4da45f2b14bd09b Sep 13 07:11:47.072924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-TestVolumeBootPattern-2077651277 Sep 13 07:11:47.072924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-TestVolumeBootPattern-2077651277-project Sep 13 07:11:47.072924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:11:47.072924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:11:47.072924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 67fa873d16414749bc478a59de3ec5b4 Sep 13 07:11:47.072924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-TestVolumeBootPattern-2077651277-project Sep 13 07:11:47.072924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:11:47.072924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance 7e083757-8d71-44e3-a1c7-adca051e9296 could not be found. Sep 13 07:11:47.072924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': '7e083757-8d71-44e3-a1c7-adca051e9296'} Sep 13 07:11:47.074358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:11:47.074358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:47.074358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:11:47.074358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:11:47.074358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:11:47.074358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:11:47.074358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:11:47.074358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:11:47.074358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:11:47.074358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:11:47.074358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e083757-8d71-44e3-a1c7-adca051e9296 could not be found. Sep 13 07:11:47.074358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.074358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:47.074358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.074358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:47.074358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:47.074358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:47.074358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:11:47.074358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:11:47.074358 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:11:47.075848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:11:47.075848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:11:47.075848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:11:47.075848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:11:47.075848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:11:47.075848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:11:47.075848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:11:47.075848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e083757-8d71-44e3-a1c7-adca051e9296 could not be found. Sep 13 07:11:47.075848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.075848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:47.075848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.075848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:47.075848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:47.075848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:47.075848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:11:47.075848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:11:47.075848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e083757-8d71-44e3-a1c7-adca051e9296 could not be found. Sep 13 07:11:47.075848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.077396 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0afffc52-ca0a-4c7c-acf7-fb1541a7d4d1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Returning 404 to user: Instance 7e083757-8d71-44e3-a1c7-adca051e9296 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:11:47.077396 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0afffc52-ca0a-4c7c-acf7-fb1541a7d4d1 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296" status: 404 len: 111 microversion: 2.1 time: 0.033054 Sep 13 07:11:47.077396 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 542/1049] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:11:47 2022] GET /compute/v2.1/servers/7e083757-8d71-44e3-a1c7-adca051e9296 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:11:47.441737 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3c6fa162-07a1-478f-9381-c2fb7f28be26 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Calling method '.version_select at 0x7f4c1966ed30>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:47.470548 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-3c6fa162-07a1-478f-9381-c2fb7f28be26 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] HTTP exception thrown: Volume 89e34b45-a912-452e-bf20-d53f2388d96c could not be found. Sep 13 07:11:47.472911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3c6fa162-07a1-478f-9381-c2fb7f28be26 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Request method failure captured: Sep 13 07:11:47.472911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/os-volumes/89e34b45-a912-452e-bf20-d53f2388d96c HTTP/1.1 Sep 13 07:11:47.472911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:11:47.472911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:11:47.472911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:11:47.472911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:11:47.472911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:11:47.472911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:11:47.472911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:11:47.472911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:11:47.472911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjIC0r4t6HyiBp-4_3kHCzGll166nLAbQVOvHMXq_OgxaaD_df0lXODq9Z5i_cytmfjfIJ-s8qG2Moosqk8QlRPp_kb67SPKALqJ_lDp1lq3B45pskfBgEbpydTagMgh589ZXBNvPBjr9ZobsUJI-meIxSRg23ve2yMh27m3X88nbpjX4 Sep 13 07:11:47.472911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:11:47.472911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:11:47.472911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:11:47.472911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:11:47.472911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:11:47.472911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:11:47.472911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: c256c5ce95db432b850fd7c7392ac214 Sep 13 07:11:47.472911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1442828287 Sep 13 07:11:47.472911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:11:47.472911 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:11:47.474627 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c256c5ce95db432b850fd7c7392ac214"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c256c5ce95db432b850fd7c7392ac214"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c256c5ce95db432b850fd7c7392ac214"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c256c5ce95db432b850fd7c7392ac214", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:11:47.474627 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1442828287 Sep 13 07:11:47.474627 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: c256c5ce95db432b850fd7c7392ac214 Sep 13 07:11:47.474627 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1442828287 Sep 13 07:11:47.474627 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-VolumesSnapshotsTestJSON-1442828287-project Sep 13 07:11:47.474627 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:11:47.474627 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:11:47.474627 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: bbebe495e6da4c80b5c8ffa30069d4e3 Sep 13 07:11:47.474627 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1442828287-project Sep 13 07:11:47.474627 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: Sep 13 07:11:47.474627 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Volume 89e34b45-a912-452e-bf20-d53f2388d96c could not be found. Sep 13 07:11:47.474627 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': '89e34b45-a912-452e-bf20-d53f2388d96c'} Sep 13 07:11:47.474627 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:11:47.475675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:47.475675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:11:47.475675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:11:47.475675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 07:11:47.475675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 07:11:47.475675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 07:11:47.475675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 07:11:47.475675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 07:11:47.475675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 07:11:47.475675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 07:11:47.475675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 07:11:47.475675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:11:47.475675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:11:47.475675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:11:47.475675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:11:47.475675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 89e34b45-a912-452e-bf20-d53f2388d96c could not be found. (HTTP 404) (Request-ID: req-575abf31-553d-425f-bfe8-ea455cbed9b5) Sep 13 07:11:47.475675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.475675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:47.475675 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.477175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:47.477175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 07:11:47.477175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 07:11:47.477175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 07:11:47.477175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 07:11:47.477175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 07:11:47.477175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 07:11:47.477175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 07:11:47.477175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 07:11:47.477175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:11:47.477175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:11:47.477175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 07:11:47.477175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 07:11:47.477175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 07:11:47.477175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 07:11:47.477175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 07:11:47.477175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 07:11:47.477175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 07:11:47.477175 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 07:11:47.479073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:11:47.479073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:11:47.479073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:11:47.479073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:11:47.479073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 89e34b45-a912-452e-bf20-d53f2388d96c could not be found. Sep 13 07:11:47.479073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.479073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:47.479073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.479073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:47.479073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:47.479073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:47.479073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:11:47.479073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:11:47.479073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 07:11:47.479073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 07:11:47.479073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:11:47.479073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:11:47.479073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 07:11:47.479073 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:11:47.481176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 89e34b45-a912-452e-bf20-d53f2388d96c could not be found. Sep 13 07:11:47.481176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.481176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:47.481176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.481176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:47.481176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:47.481176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:47.481176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:11:47.481176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:11:47.481176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 89e34b45-a912-452e-bf20-d53f2388d96c could not be found. Sep 13 07:11:47.481176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.481176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3c6fa162-07a1-478f-9381-c2fb7f28be26 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Returning 404 to user: Volume 89e34b45-a912-452e-bf20-d53f2388d96c could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:11:47.481176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3c6fa162-07a1-478f-9381-c2fb7f28be26 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/89e34b45-a912-452e-bf20-d53f2388d96c" status: 404 len: 109 microversion: 2.1 time: 0.037134 Sep 13 07:11:47.481176 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 508/1050] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Sep 13 07:11:47 2022] GET /compute/v2.1/os-volumes/89e34b45-a912-452e-bf20-d53f2388d96c => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:11:47.485367 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c0f7643e-6f2a-494e-bbb5-7ce3a0342067 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Calling method '.version_select at 0x7f4c196dc940>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:47.515324 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-c0f7643e-6f2a-494e-bbb5-7ce3a0342067 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] HTTP exception thrown: Volume 89e34b45-a912-452e-bf20-d53f2388d96c could not be found. Sep 13 07:11:47.517374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c0f7643e-6f2a-494e-bbb5-7ce3a0342067 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Request method failure captured: Sep 13 07:11:47.517374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/os-volumes/89e34b45-a912-452e-bf20-d53f2388d96c HTTP/1.1 Sep 13 07:11:47.517374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:11:47.517374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:11:47.517374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:11:47.517374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:11:47.517374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:11:47.517374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:11:47.517374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:11:47.517374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:11:47.517374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjIC0r4t6HyiBp-4_3kHCzGll166nLAbQVOvHMXq_OgxaaD_df0lXODq9Z5i_cytmfjfIJ-s8qG2Moosqk8QlRPp_kb67SPKALqJ_lDp1lq3B45pskfBgEbpydTagMgh589ZXBNvPBjr9ZobsUJI-meIxSRg23ve2yMh27m3X88nbpjX4 Sep 13 07:11:47.517374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:11:47.517374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:11:47.517374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:11:47.517374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:11:47.517374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:11:47.517374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:11:47.517374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: c256c5ce95db432b850fd7c7392ac214 Sep 13 07:11:47.517374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1442828287 Sep 13 07:11:47.517374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:11:47.517374 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:11:47.519062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c256c5ce95db432b850fd7c7392ac214"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c256c5ce95db432b850fd7c7392ac214"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c256c5ce95db432b850fd7c7392ac214"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c256c5ce95db432b850fd7c7392ac214", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:11:47.519062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1442828287 Sep 13 07:11:47.519062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: c256c5ce95db432b850fd7c7392ac214 Sep 13 07:11:47.519062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1442828287 Sep 13 07:11:47.519062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-VolumesSnapshotsTestJSON-1442828287-project Sep 13 07:11:47.519062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:11:47.519062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:11:47.519062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: bbebe495e6da4c80b5c8ffa30069d4e3 Sep 13 07:11:47.519062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1442828287-project Sep 13 07:11:47.519062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: Sep 13 07:11:47.519062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Volume 89e34b45-a912-452e-bf20-d53f2388d96c could not be found. Sep 13 07:11:47.519062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': '89e34b45-a912-452e-bf20-d53f2388d96c'} Sep 13 07:11:47.519062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:11:47.519967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:47.519967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:11:47.519967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:11:47.519967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 07:11:47.519967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 07:11:47.519967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 07:11:47.519967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 07:11:47.519967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 07:11:47.519967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 07:11:47.519967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 07:11:47.519967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 07:11:47.519967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:11:47.519967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:11:47.519967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:11:47.519967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:11:47.519967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 89e34b45-a912-452e-bf20-d53f2388d96c could not be found. (HTTP 404) (Request-ID: req-4e1450a3-fa1f-4763-aea2-882c27585941) Sep 13 07:11:47.519967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.519967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:47.519967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.521186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:47.521186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 07:11:47.521186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 07:11:47.521186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 07:11:47.521186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 07:11:47.521186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 07:11:47.521186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 07:11:47.521186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 07:11:47.521186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 07:11:47.521186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:11:47.521186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:11:47.521186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 07:11:47.521186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 07:11:47.521186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 07:11:47.521186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 07:11:47.521186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 07:11:47.521186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 07:11:47.521186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 07:11:47.521186 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 07:11:47.522413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:11:47.522413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:11:47.522413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:11:47.522413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:11:47.522413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 89e34b45-a912-452e-bf20-d53f2388d96c could not be found. Sep 13 07:11:47.522413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.522413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:47.522413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.522413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:47.522413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:47.522413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:47.522413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:11:47.522413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:11:47.522413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 07:11:47.522413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 07:11:47.522413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:11:47.522413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:11:47.522413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 07:11:47.522413 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:11:47.523924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 89e34b45-a912-452e-bf20-d53f2388d96c could not be found. Sep 13 07:11:47.523924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.523924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:47.523924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.523924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:47.523924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:47.523924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:47.523924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:11:47.523924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:11:47.523924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 89e34b45-a912-452e-bf20-d53f2388d96c could not be found. Sep 13 07:11:47.523924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.523924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c0f7643e-6f2a-494e-bbb5-7ce3a0342067 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Returning 404 to user: Volume 89e34b45-a912-452e-bf20-d53f2388d96c could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:11:47.523924 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c0f7643e-6f2a-494e-bbb5-7ce3a0342067 tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/89e34b45-a912-452e-bf20-d53f2388d96c" status: 404 len: 109 microversion: 2.1 time: 0.037862 Sep 13 07:11:47.525451 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 543/1051] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Sep 13 07:11:47 2022] DELETE /compute/v2.1/os-volumes/89e34b45-a912-452e-bf20-d53f2388d96c => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:11:47.528125 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ab5726c8-0999-40cd-ac33-5ef254f6512d tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Calling method '.version_select at 0x7f4c196704c0>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:47.557078 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-ab5726c8-0999-40cd-ac33-5ef254f6512d tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] HTTP exception thrown: Volume 89e34b45-a912-452e-bf20-d53f2388d96c could not be found. Sep 13 07:11:47.559159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ab5726c8-0999-40cd-ac33-5ef254f6512d tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Request method failure captured: Sep 13 07:11:47.559159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/os-volumes/89e34b45-a912-452e-bf20-d53f2388d96c HTTP/1.1 Sep 13 07:11:47.559159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:11:47.559159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:11:47.559159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:11:47.559159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:11:47.559159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:11:47.559159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:11:47.559159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:11:47.559159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:11:47.559159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjIC0r4t6HyiBp-4_3kHCzGll166nLAbQVOvHMXq_OgxaaD_df0lXODq9Z5i_cytmfjfIJ-s8qG2Moosqk8QlRPp_kb67SPKALqJ_lDp1lq3B45pskfBgEbpydTagMgh589ZXBNvPBjr9ZobsUJI-meIxSRg23ve2yMh27m3X88nbpjX4 Sep 13 07:11:47.559159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:11:47.559159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:11:47.559159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:11:47.559159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:11:47.559159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:11:47.559159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:11:47.559159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: c256c5ce95db432b850fd7c7392ac214 Sep 13 07:11:47.559159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1442828287 Sep 13 07:11:47.559159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:11:47.559159 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:11:47.560570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c256c5ce95db432b850fd7c7392ac214"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c256c5ce95db432b850fd7c7392ac214"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c256c5ce95db432b850fd7c7392ac214"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c256c5ce95db432b850fd7c7392ac214", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:11:47.560570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1442828287 Sep 13 07:11:47.560570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: c256c5ce95db432b850fd7c7392ac214 Sep 13 07:11:47.560570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1442828287 Sep 13 07:11:47.560570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-VolumesSnapshotsTestJSON-1442828287-project Sep 13 07:11:47.560570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:11:47.560570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:11:47.560570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: bbebe495e6da4c80b5c8ffa30069d4e3 Sep 13 07:11:47.560570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1442828287-project Sep 13 07:11:47.560570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: Sep 13 07:11:47.560570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Volume 89e34b45-a912-452e-bf20-d53f2388d96c could not be found. Sep 13 07:11:47.560570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': '89e34b45-a912-452e-bf20-d53f2388d96c'} Sep 13 07:11:47.560570 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:11:47.561391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:47.561391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:11:47.561391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:11:47.561391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 07:11:47.561391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 07:11:47.561391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 07:11:47.561391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 07:11:47.561391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 07:11:47.561391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 07:11:47.561391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 07:11:47.561391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 07:11:47.561391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:11:47.561391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:11:47.561391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:11:47.561391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:11:47.561391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 89e34b45-a912-452e-bf20-d53f2388d96c could not be found. (HTTP 404) (Request-ID: req-b8726fe4-77e3-4aa6-be41-cc26d3e467cc) Sep 13 07:11:47.561391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.561391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:47.561391 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.562754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:47.562754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 07:11:47.562754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 07:11:47.562754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 07:11:47.562754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 07:11:47.562754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 07:11:47.562754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 07:11:47.562754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 07:11:47.562754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 07:11:47.562754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:11:47.562754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:11:47.562754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 07:11:47.562754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 07:11:47.562754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 07:11:47.562754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 07:11:47.562754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 07:11:47.562754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 07:11:47.562754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 07:11:47.562754 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 07:11:47.564156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:11:47.564156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:11:47.564156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:11:47.564156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:11:47.564156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 89e34b45-a912-452e-bf20-d53f2388d96c could not be found. Sep 13 07:11:47.564156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.564156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:47.564156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.564156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:47.564156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:47.564156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:47.564156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:11:47.564156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:11:47.564156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 07:11:47.564156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 07:11:47.564156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:11:47.564156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:11:47.564156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 07:11:47.564156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:11:47.565513 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 89e34b45-a912-452e-bf20-d53f2388d96c could not be found. Sep 13 07:11:47.565513 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.565513 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:47.565513 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.565513 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:47.565513 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:47.565513 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:47.565513 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:11:47.565513 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:11:47.565513 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 89e34b45-a912-452e-bf20-d53f2388d96c could not be found. Sep 13 07:11:47.565513 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:47.565513 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ab5726c8-0999-40cd-ac33-5ef254f6512d tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] Returning 404 to user: Volume 89e34b45-a912-452e-bf20-d53f2388d96c could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:11:47.565513 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ab5726c8-0999-40cd-ac33-5ef254f6512d tempest-VolumesSnapshotsTestJSON-1442828287 tempest-VolumesSnapshotsTestJSON-1442828287-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/89e34b45-a912-452e-bf20-d53f2388d96c" status: 404 len: 109 microversion: 2.1 time: 0.036870 Sep 13 07:11:47.565513 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 509/1052] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Sep 13 07:11:47 2022] GET /compute/v2.1/os-volumes/89e34b45-a912-452e-bf20-d53f2388d96c => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:11:49.105117 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6bea691b-a1f5-45dc-831a-f87759cbb460 tempest-VolumesGetTestJSON-950546754 tempest-VolumesGetTestJSON-950546754-project] Action: 'create', calling method: .version_select at 0x7f4c194de4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-398527268", "metadata": {"Type": "work"}}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:11:49.439278 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6bea691b-a1f5-45dc-831a-f87759cbb460 tempest-VolumesGetTestJSON-950546754 tempest-VolumesGetTestJSON-950546754-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.454873 Sep 13 07:11:49.440040 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 544/1053] 10.222.0.25 () {60 vars in 1156 bytes} [Tue Sep 13 07:11:48 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 456 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 07:11:49.453708 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4b3f11ef-1219-49b7-b8ff-a91b37461f0e tempest-VolumesGetTestJSON-950546754 tempest-VolumesGetTestJSON-950546754-project] Calling method '.version_select at 0x7f4c19670310>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:49.505191 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4b3f11ef-1219-49b7-b8ff-a91b37461f0e tempest-VolumesGetTestJSON-950546754 tempest-VolumesGetTestJSON-950546754-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/b8f89d7b-cb31-4f68-ab5c-9fba24dd5f4c" status: 200 len: 352 microversion: 2.1 time: 0.055874 Sep 13 07:11:49.505755 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 510/1054] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Sep 13 07:11:49 2022] GET /compute/v2.1/os-volumes/b8f89d7b-cb31-4f68-ab5c-9fba24dd5f4c => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:11:50.205821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2f6fb477-f479-4795-a63e-cd8d7b17a2c9 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:50.206584 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2f6fb477-f479-4795-a63e-cd8d7b17a2c9 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:50.207628 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-b73182a0-5493-4b1c-97fe-3fb8022cbf48 req-fe80c43f-603c-440d-819d-f041e3eb6e8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce5618c6-5eed-4097-9add-4943c7251e95", "tag": "8123a51f-2109-4966-a1db-e715035c1e0e"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:11:50.213492 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2f6fb477-f479-4795-a63e-cd8d7b17a2c9 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:50.213990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2f6fb477-f479-4795-a63e-cd8d7b17a2c9 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:50.214520 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2f6fb477-f479-4795-a63e-cd8d7b17a2c9 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:50.215240 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2f6fb477-f479-4795-a63e-cd8d7b17a2c9 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:50.215683 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2f6fb477-f479-4795-a63e-cd8d7b17a2c9 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:50.216101 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2f6fb477-f479-4795-a63e-cd8d7b17a2c9 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:50.219058 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-b73182a0-5493-4b1c-97fe-3fb8022cbf48 req-fe80c43f-603c-440d-819d-f041e3eb6e8b service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:50.219606 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-b73182a0-5493-4b1c-97fe-3fb8022cbf48 req-fe80c43f-603c-440d-819d-f041e3eb6e8b service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:50.220099 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-b73182a0-5493-4b1c-97fe-3fb8022cbf48 req-fe80c43f-603c-440d-819d-f041e3eb6e8b service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:50.231071 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-b73182a0-5493-4b1c-97fe-3fb8022cbf48 req-fe80c43f-603c-440d-819d-f041e3eb6e8b service nova] Creating event network-changed:8123a51f-2109-4966-a1db-e715035c1e0e for instance ce5618c6-5eed-4097-9add-4943c7251e95 on hv-cinder-85694 Sep 13 07:11:50.237018 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-b73182a0-5493-4b1c-97fe-3fb8022cbf48 req-fe80c43f-603c-440d-819d-f041e3eb6e8b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033427 Sep 13 07:11:50.237866 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 511/1055] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:50.242373 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2f6fb477-f479-4795-a63e-cd8d7b17a2c9 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:11:50.334041 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2f6fb477-f479-4795-a63e-cd8d7b17a2c9 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 204 len: 0 microversion: 2.1 time: 0.132421 Sep 13 07:11:50.335478 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 545/1056] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:11:50 2022] DELETE /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:11:50.344386 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3649edc1-1aa0-482c-bf94-cb27ce314efc tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:50.345404 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3649edc1-1aa0-482c-bf94-cb27ce314efc tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:50.351902 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3649edc1-1aa0-482c-bf94-cb27ce314efc tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:50.352389 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3649edc1-1aa0-482c-bf94-cb27ce314efc tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:50.352923 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3649edc1-1aa0-482c-bf94-cb27ce314efc tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:50.353673 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3649edc1-1aa0-482c-bf94-cb27ce314efc tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:50.354154 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3649edc1-1aa0-482c-bf94-cb27ce314efc tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:50.354581 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3649edc1-1aa0-482c-bf94-cb27ce314efc tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:50.487915 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3649edc1-1aa0-482c-bf94-cb27ce314efc tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:11:50.496594 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3649edc1-1aa0-482c-bf94-cb27ce314efc tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 200 len: 1578 microversion: 2.1 time: 0.156639 Sep 13 07:11:50.497146 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 512/1057] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:11:50 2022] GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:11:50.521289 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-314fcfd8-a0fa-4efd-9956-fe785676b2db tempest-VolumesGetTestJSON-950546754 tempest-VolumesGetTestJSON-950546754-project] Calling method '.version_select at 0x7f4c199b7f70>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:50.571570 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-314fcfd8-a0fa-4efd-9956-fe785676b2db tempest-VolumesGetTestJSON-950546754 tempest-VolumesGetTestJSON-950546754-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/b8f89d7b-cb31-4f68-ab5c-9fba24dd5f4c" status: 200 len: 353 microversion: 2.1 time: 0.054590 Sep 13 07:11:50.572143 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 546/1058] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Sep 13 07:11:50 2022] GET /compute/v2.1/os-volumes/b8f89d7b-cb31-4f68-ab5c-9fba24dd5f4c => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:11:50.584996 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9c6157c7-a0c9-420b-a1ae-06bd86f47ff1 tempest-VolumesGetTestJSON-950546754 tempest-VolumesGetTestJSON-950546754-project] Calling method '.version_select at 0x7f4c19683280>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:50.635313 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9c6157c7-a0c9-420b-a1ae-06bd86f47ff1 tempest-VolumesGetTestJSON-950546754 tempest-VolumesGetTestJSON-950546754-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/b8f89d7b-cb31-4f68-ab5c-9fba24dd5f4c" status: 200 len: 353 microversion: 2.1 time: 0.053964 Sep 13 07:11:50.635899 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 513/1059] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Sep 13 07:11:50 2022] GET /compute/v2.1/os-volumes/b8f89d7b-cb31-4f68-ab5c-9fba24dd5f4c => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:50.653508 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6fcab680-6efe-4101-9372-6c3df75020c4 tempest-VolumesGetTestJSON-950546754 tempest-VolumesGetTestJSON-950546754-project] Calling method '.version_select at 0x7f4c196dc1f0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:50.716241 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6fcab680-6efe-4101-9372-6c3df75020c4 tempest-VolumesGetTestJSON-950546754 tempest-VolumesGetTestJSON-950546754-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/b8f89d7b-cb31-4f68-ab5c-9fba24dd5f4c" status: 202 len: 0 microversion: 2.1 time: 0.066586 Sep 13 07:11:50.716880 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 547/1060] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Sep 13 07:11:50 2022] DELETE /compute/v2.1/os-volumes/b8f89d7b-cb31-4f68-ab5c-9fba24dd5f4c => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:11:50.725072 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-dc69f5c1-c2a4-452a-8bf5-02378bf01ca5 tempest-VolumesGetTestJSON-950546754 tempest-VolumesGetTestJSON-950546754-project] Calling method '.version_select at 0x7f4c197694c0>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:50.779425 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-dc69f5c1-c2a4-452a-8bf5-02378bf01ca5 tempest-VolumesGetTestJSON-950546754 tempest-VolumesGetTestJSON-950546754-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/b8f89d7b-cb31-4f68-ab5c-9fba24dd5f4c" status: 200 len: 352 microversion: 2.1 time: 0.058206 Sep 13 07:11:50.780009 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 514/1061] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Sep 13 07:11:50 2022] GET /compute/v2.1/os-volumes/b8f89d7b-cb31-4f68-ab5c-9fba24dd5f4c => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:11:51.520405 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-594ffb29-93a1-423b-b79c-086d147a61cf tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:51.521002 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-594ffb29-93a1-423b-b79c-086d147a61cf tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:51.528032 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-594ffb29-93a1-423b-b79c-086d147a61cf tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:51.528512 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-594ffb29-93a1-423b-b79c-086d147a61cf tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:51.528945 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-594ffb29-93a1-423b-b79c-086d147a61cf tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:51.529641 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-594ffb29-93a1-423b-b79c-086d147a61cf tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:51.530106 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-594ffb29-93a1-423b-b79c-086d147a61cf tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:51.530528 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-594ffb29-93a1-423b-b79c-086d147a61cf tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:51.676939 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-594ffb29-93a1-423b-b79c-086d147a61cf tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:11:51.686692 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-594ffb29-93a1-423b-b79c-086d147a61cf tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 200 len: 1578 microversion: 2.1 time: 0.170911 Sep 13 07:11:51.687262 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 548/1062] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:11:51 2022] GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:11:51.794790 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a3a534ce-1902-40ca-bef5-122dcb034745 tempest-VolumesGetTestJSON-950546754 tempest-VolumesGetTestJSON-950546754-project] Calling method '.version_select at 0x7f4c194c8670>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:51.824695 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-a3a534ce-1902-40ca-bef5-122dcb034745 tempest-VolumesGetTestJSON-950546754 tempest-VolumesGetTestJSON-950546754-project] HTTP exception thrown: Volume b8f89d7b-cb31-4f68-ab5c-9fba24dd5f4c could not be found. Sep 13 07:11:51.826845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a3a534ce-1902-40ca-bef5-122dcb034745 tempest-VolumesGetTestJSON-950546754 tempest-VolumesGetTestJSON-950546754-project] Request method failure captured: Sep 13 07:11:51.826845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/os-volumes/b8f89d7b-cb31-4f68-ab5c-9fba24dd5f4c HTTP/1.1 Sep 13 07:11:51.826845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:11:51.826845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:11:51.826845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:11:51.826845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:11:51.826845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:11:51.826845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:11:51.826845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:11:51.826845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:11:51.826845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjIC00Pd7eYu90UoE7cWQ8j15HJy91_t8pjP1wvEhJrLCyWo6FD5WFaMO1w9DTxHArx7Kt_Ymfa5RoHxgR7ZBvzrVSJVsJ9IXpZaLDZvn6gQZoXPmzMSF44xpidgkqATJpgabWTmv0dpW8p1NmR_CJhq7FI86XlYrqvGA2kbcd9XyzWDc Sep 13 07:11:51.826845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:11:51.826845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:11:51.826845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:11:51.826845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:11:51.826845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:11:51.826845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:11:51.826845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: e6c99b17634d4c1394fbe1ef73d32476 Sep 13 07:11:51.826845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-VolumesGetTestJSON-950546754 Sep 13 07:11:51.826845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:11:51.826845 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:11:51.828624 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e6c99b17634d4c1394fbe1ef73d32476"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e6c99b17634d4c1394fbe1ef73d32476"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e6c99b17634d4c1394fbe1ef73d32476"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e6c99b17634d4c1394fbe1ef73d32476", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:11:51.828624 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-VolumesGetTestJSON-950546754 Sep 13 07:11:51.828624 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: e6c99b17634d4c1394fbe1ef73d32476 Sep 13 07:11:51.828624 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-VolumesGetTestJSON-950546754 Sep 13 07:11:51.828624 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-VolumesGetTestJSON-950546754-project Sep 13 07:11:51.828624 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:11:51.828624 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:11:51.828624 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: 7828799c772a429b9f3cfdb636d2bdb9 Sep 13 07:11:51.828624 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-VolumesGetTestJSON-950546754-project Sep 13 07:11:51.828624 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: Sep 13 07:11:51.828624 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Volume b8f89d7b-cb31-4f68-ab5c-9fba24dd5f4c could not be found. Sep 13 07:11:51.828624 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': 'b8f89d7b-cb31-4f68-ab5c-9fba24dd5f4c'} Sep 13 07:11:51.828624 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:11:51.829728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:51.829728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:11:51.829728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:11:51.829728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 07:11:51.829728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 07:11:51.829728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 07:11:51.829728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 07:11:51.829728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 07:11:51.829728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 07:11:51.829728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 07:11:51.829728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 07:11:51.829728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:11:51.829728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:11:51.829728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:11:51.829728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:11:51.829728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b8f89d7b-cb31-4f68-ab5c-9fba24dd5f4c could not be found. (HTTP 404) (Request-ID: req-ea2735c5-55c2-46ea-b703-78ccdd460ba3) Sep 13 07:11:51.829728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:51.829728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:51.829728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:51.831350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:51.831350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 07:11:51.831350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 07:11:51.831350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 07:11:51.831350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 07:11:51.831350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 07:11:51.831350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 07:11:51.831350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 07:11:51.831350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 07:11:51.831350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:11:51.831350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:11:51.831350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 07:11:51.831350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 07:11:51.831350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 07:11:51.831350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 07:11:51.831350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 07:11:51.831350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 07:11:51.831350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 07:11:51.831350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 07:11:51.832840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:11:51.832840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:11:51.832840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:11:51.832840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:11:51.832840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b8f89d7b-cb31-4f68-ab5c-9fba24dd5f4c could not be found. Sep 13 07:11:51.832840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:51.832840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:51.832840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:51.832840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:51.832840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:51.832840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:51.832840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:11:51.832840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:11:51.832840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 07:11:51.832840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 07:11:51.832840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:11:51.832840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:11:51.832840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 07:11:51.832840 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:11:51.834426 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b8f89d7b-cb31-4f68-ab5c-9fba24dd5f4c could not be found. Sep 13 07:11:51.834426 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:51.834426 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:51.834426 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:51.834426 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:51.834426 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:51.834426 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:51.834426 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:11:51.834426 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:11:51.834426 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b8f89d7b-cb31-4f68-ab5c-9fba24dd5f4c could not be found. Sep 13 07:11:51.834426 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:51.834426 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a3a534ce-1902-40ca-bef5-122dcb034745 tempest-VolumesGetTestJSON-950546754 tempest-VolumesGetTestJSON-950546754-project] Returning 404 to user: Volume b8f89d7b-cb31-4f68-ab5c-9fba24dd5f4c could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:11:51.834426 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a3a534ce-1902-40ca-bef5-122dcb034745 tempest-VolumesGetTestJSON-950546754 tempest-VolumesGetTestJSON-950546754-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/b8f89d7b-cb31-4f68-ab5c-9fba24dd5f4c" status: 404 len: 109 microversion: 2.1 time: 0.038395 Sep 13 07:11:51.834426 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 515/1063] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Sep 13 07:11:51 2022] GET /compute/v2.1/os-volumes/b8f89d7b-cb31-4f68-ab5c-9fba24dd5f4c => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:11:52.710868 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-89f9b35d-f45d-454a-914f-d13b4e51b50c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:52.711527 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-89f9b35d-f45d-454a-914f-d13b4e51b50c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:52.718343 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89f9b35d-f45d-454a-914f-d13b4e51b50c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:52.718830 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89f9b35d-f45d-454a-914f-d13b4e51b50c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:52.719252 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89f9b35d-f45d-454a-914f-d13b4e51b50c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:52.719953 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89f9b35d-f45d-454a-914f-d13b4e51b50c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:52.720397 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89f9b35d-f45d-454a-914f-d13b4e51b50c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:52.720811 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89f9b35d-f45d-454a-914f-d13b4e51b50c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:52.979519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-89f9b35d-f45d-454a-914f-d13b4e51b50c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fa873d16414749bc478a59de3ec5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bbe5cbd59f4feda4da45f2b14bd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:11:52.988962 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-a618181e-157c-41d2-8647-78c94681a3b3 req-128139c3-aac5-4c7c-8678-efcd9bf98b55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5618c6-5eed-4097-9add-4943c7251e95", "name": "network-vif-deleted", "tag": "8123a51f-2109-4966-a1db-e715035c1e0e"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:11:52.999755 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-a618181e-157c-41d2-8647-78c94681a3b3 req-128139c3-aac5-4c7c-8678-efcd9bf98b55 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:53.000535 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-a618181e-157c-41d2-8647-78c94681a3b3 req-128139c3-aac5-4c7c-8678-efcd9bf98b55 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:53.001147 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-a618181e-157c-41d2-8647-78c94681a3b3 req-128139c3-aac5-4c7c-8678-efcd9bf98b55 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:53.004494 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-89f9b35d-f45d-454a-914f-d13b4e51b50c tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 200 len: 1391 microversion: 2.1 time: 0.297408 Sep 13 07:11:53.005412 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 549/1064] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:11:52 2022] GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 1391 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:11:53.013981 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-a618181e-157c-41d2-8647-78c94681a3b3 req-128139c3-aac5-4c7c-8678-efcd9bf98b55 service nova] Creating event network-vif-deleted:8123a51f-2109-4966-a1db-e715035c1e0e for instance ce5618c6-5eed-4097-9add-4943c7251e95 on hv-cinder-85694 Sep 13 07:11:53.021121 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-a618181e-157c-41d2-8647-78c94681a3b3 req-128139c3-aac5-4c7c-8678-efcd9bf98b55 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035723 Sep 13 07:11:53.021724 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 516/1065] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:11:54.034593 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5452a478-41b6-4f28-a0b2-c80af8d2c279 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:54.035200 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5452a478-41b6-4f28-a0b2-c80af8d2c279 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: ce5618c6-5eed-4097-9add-4943c7251e95] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:54.042642 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5452a478-41b6-4f28-a0b2-c80af8d2c279 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:54.043131 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5452a478-41b6-4f28-a0b2-c80af8d2c279 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:54.044206 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5452a478-41b6-4f28-a0b2-c80af8d2c279 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:54.044909 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5452a478-41b6-4f28-a0b2-c80af8d2c279 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:54.045359 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5452a478-41b6-4f28-a0b2-c80af8d2c279 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:54.045775 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5452a478-41b6-4f28-a0b2-c80af8d2c279 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:54.061191 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-5452a478-41b6-4f28-a0b2-c80af8d2c279 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] HTTP exception thrown: Instance ce5618c6-5eed-4097-9add-4943c7251e95 could not be found. Sep 13 07:11:54.062881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5452a478-41b6-4f28-a0b2-c80af8d2c279 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Request method failure captured: Sep 13 07:11:54.062881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 HTTP/1.1 Sep 13 07:11:54.062881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:11:54.062881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:11:54.062881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:11:54.062881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:11:54.062881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:11:54.062881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:11:54.062881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:11:54.062881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:11:54.062881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICt9Lj4_bEAvQVyFr7NuHfrDtiIH3Txfam13pusmwJ6IKF3fVnHbtRtJ8nNxQs_hOFQZdK7LzDouqsp2xWTr2w88N3LQTnQ6Hx_rWq7NNmCxdEIAAANuK_3kHmkwcI5QDGrO9eDBylk8h3swDl36x9AlTa1aIeGwA8hiQzjgxEjU56g Sep 13 07:11:54.062881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:11:54.062881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:11:54.062881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:11:54.062881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:11:54.062881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:11:54.062881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:11:54.062881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 99bbe5cbd59f4feda4da45f2b14bd09b Sep 13 07:11:54.062881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-TestVolumeBootPattern-2077651277 Sep 13 07:11:54.062881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:11:54.062881 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:11:54.064395 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/99bbe5cbd59f4feda4da45f2b14bd09b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bbe5cbd59f4feda4da45f2b14bd09b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bbe5cbd59f4feda4da45f2b14bd09b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_99bbe5cbd59f4feda4da45f2b14bd09b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:11:54.064395 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-TestVolumeBootPattern-2077651277 Sep 13 07:11:54.064395 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 99bbe5cbd59f4feda4da45f2b14bd09b Sep 13 07:11:54.064395 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-TestVolumeBootPattern-2077651277 Sep 13 07:11:54.064395 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-TestVolumeBootPattern-2077651277-project Sep 13 07:11:54.064395 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:11:54.064395 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:11:54.064395 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 67fa873d16414749bc478a59de3ec5b4 Sep 13 07:11:54.064395 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-TestVolumeBootPattern-2077651277-project Sep 13 07:11:54.064395 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:11:54.064395 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance ce5618c6-5eed-4097-9add-4943c7251e95 could not be found. Sep 13 07:11:54.064395 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': 'ce5618c6-5eed-4097-9add-4943c7251e95'} Sep 13 07:11:54.065181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:11:54.065181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:54.065181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:11:54.065181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:11:54.065181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:11:54.065181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:11:54.065181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:11:54.065181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:11:54.065181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:11:54.065181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:11:54.065181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce5618c6-5eed-4097-9add-4943c7251e95 could not be found. Sep 13 07:11:54.065181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:54.065181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:54.065181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:54.065181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:54.065181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:54.065181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:54.065181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:11:54.065181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:11:54.065181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:11:54.066582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:11:54.066582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:11:54.066582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:11:54.066582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:11:54.066582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:11:54.066582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:11:54.066582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:11:54.066582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce5618c6-5eed-4097-9add-4943c7251e95 could not be found. Sep 13 07:11:54.066582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:54.066582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:54.066582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:54.066582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:54.066582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:54.066582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:54.066582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:11:54.066582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:11:54.066582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce5618c6-5eed-4097-9add-4943c7251e95 could not be found. Sep 13 07:11:54.066582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:54.067743 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5452a478-41b6-4f28-a0b2-c80af8d2c279 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Returning 404 to user: Instance ce5618c6-5eed-4097-9add-4943c7251e95 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:11:54.067743 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5452a478-41b6-4f28-a0b2-c80af8d2c279 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95" status: 404 len: 111 microversion: 2.1 time: 0.033958 Sep 13 07:11:54.067743 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 550/1066] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:11:54 2022] GET /compute/v2.1/servers/ce5618c6-5eed-4097-9add-4943c7251e95 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:11:54.577068 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f23c7454-cda3-4059-8920-215c9c6d3c40 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:54.577668 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f23c7454-cda3-4059-8920-215c9c6d3c40 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:54.584718 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f23c7454-cda3-4059-8920-215c9c6d3c40 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:54.585199 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f23c7454-cda3-4059-8920-215c9c6d3c40 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:54.585626 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f23c7454-cda3-4059-8920-215c9c6d3c40 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:54.586349 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f23c7454-cda3-4059-8920-215c9c6d3c40 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:54.586790 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f23c7454-cda3-4059-8920-215c9c6d3c40 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:54.587205 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f23c7454-cda3-4059-8920-215c9c6d3c40 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:54.609915 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-f23c7454-cda3-4059-8920-215c9c6d3c40 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] HTTP exception thrown: Instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 could not be found. Sep 13 07:11:54.611939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f23c7454-cda3-4059-8920-215c9c6d3c40 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Request method failure captured: Sep 13 07:11:54.611939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: DELETE /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 HTTP/1.1 Sep 13 07:11:54.611939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:11:54.611939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:11:54.611939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:11:54.611939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:11:54.611939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:11:54.611939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:11:54.611939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:11:54.611939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:11:54.611939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjICt9Lj4_bEAvQVyFr7NuHfrDtiIH3Txfam13pusmwJ6IKF3fVnHbtRtJ8nNxQs_hOFQZdK7LzDouqsp2xWTr2w88N3LQTnQ6Hx_rWq7NNmCxdEIAAANuK_3kHmkwcI5QDGrO9eDBylk8h3swDl36x9AlTa1aIeGwA8hiQzjgxEjU56g Sep 13 07:11:54.611939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:11:54.611939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:11:54.611939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:11:54.611939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:11:54.611939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:11:54.611939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:11:54.611939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: 99bbe5cbd59f4feda4da45f2b14bd09b Sep 13 07:11:54.611939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-TestVolumeBootPattern-2077651277 Sep 13 07:11:54.611939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:11:54.611939 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:11:54.613631 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/99bbe5cbd59f4feda4da45f2b14bd09b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bbe5cbd59f4feda4da45f2b14bd09b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bbe5cbd59f4feda4da45f2b14bd09b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_99bbe5cbd59f4feda4da45f2b14bd09b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:11:54.613631 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-TestVolumeBootPattern-2077651277 Sep 13 07:11:54.613631 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 99bbe5cbd59f4feda4da45f2b14bd09b Sep 13 07:11:54.613631 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-TestVolumeBootPattern-2077651277 Sep 13 07:11:54.613631 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-TestVolumeBootPattern-2077651277-project Sep 13 07:11:54.613631 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:11:54.613631 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:11:54.613631 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: 67fa873d16414749bc478a59de3ec5b4 Sep 13 07:11:54.613631 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-TestVolumeBootPattern-2077651277-project Sep 13 07:11:54.613631 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:11:54.613631 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 could not be found. Sep 13 07:11:54.613631 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': 'df5f6f23-54e8-43b0-a5a3-6e336b2a3582'} Sep 13 07:11:54.614811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:11:54.614811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:54.614811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:11:54.614811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:11:54.614811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:11:54.614811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:11:54.614811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:11:54.614811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:11:54.614811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:11:54.614811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:11:54.614811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 could not be found. Sep 13 07:11:54.614811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:54.614811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:54.614811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:54.614811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:54.614811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:54.614811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:54.614811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:11:54.614811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:11:54.614811 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:11:54.616374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:11:54.616374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 07:11:54.616374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 07:11:54.616374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 07:11:54.616374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 07:11:54.616374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:11:54.616374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:11:54.616374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:11:54.616374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:11:54.616374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 could not be found. Sep 13 07:11:54.616374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:54.616374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:54.616374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:54.616374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:54.616374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:54.616374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:54.616374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:11:54.616374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:11:54.616374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 could not be found. Sep 13 07:11:54.616374 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:11:54.618524 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f23c7454-cda3-4059-8920-215c9c6d3c40 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Returning 404 to user: Instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:11:54.618524 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f23c7454-cda3-4059-8920-215c9c6d3c40 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "DELETE /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 404 len: 111 microversion: 2.1 time: 0.040188 Sep 13 07:11:54.618524 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 517/1067] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:11:54 2022] DELETE /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:11:54.622359 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9fd82792-8e42-4370-855e-369d019f919f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:54.622973 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9fd82792-8e42-4370-855e-369d019f919f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] [instance: df5f6f23-54e8-43b0-a5a3-6e336b2a3582] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:11:54.629054 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9fd82792-8e42-4370-855e-369d019f919f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:54.629529 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9fd82792-8e42-4370-855e-369d019f919f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:54.629950 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9fd82792-8e42-4370-855e-369d019f919f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:54.630656 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9fd82792-8e42-4370-855e-369d019f919f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:11:54.631101 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9fd82792-8e42-4370-855e-369d019f919f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:11:54.631516 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9fd82792-8e42-4370-855e-369d019f919f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:11:54.646039 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-9fd82792-8e42-4370-855e-369d019f919f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] HTTP exception thrown: Instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 could not be found. Sep 13 07:11:54.647592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9fd82792-8e42-4370-855e-369d019f919f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Request method failure captured: Sep 13 07:11:54.647592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 HTTP/1.1 Sep 13 07:11:54.647592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:11:54.647592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:11:54.647592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:11:54.647592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:11:54.647592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:11:54.647592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:11:54.647592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:11:54.647592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:11:54.647592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjICt9Lj4_bEAvQVyFr7NuHfrDtiIH3Txfam13pusmwJ6IKF3fVnHbtRtJ8nNxQs_hOFQZdK7LzDouqsp2xWTr2w88N3LQTnQ6Hx_rWq7NNmCxdEIAAANuK_3kHmkwcI5QDGrO9eDBylk8h3swDl36x9AlTa1aIeGwA8hiQzjgxEjU56g Sep 13 07:11:54.647592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:11:54.647592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:11:54.647592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:11:54.647592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:11:54.647592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:11:54.647592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:11:54.647592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: 99bbe5cbd59f4feda4da45f2b14bd09b Sep 13 07:11:54.647592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-TestVolumeBootPattern-2077651277 Sep 13 07:11:54.647592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:11:54.647592 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:11:54.649180 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/99bbe5cbd59f4feda4da45f2b14bd09b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bbe5cbd59f4feda4da45f2b14bd09b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bbe5cbd59f4feda4da45f2b14bd09b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_99bbe5cbd59f4feda4da45f2b14bd09b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:11:54.649180 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-TestVolumeBootPattern-2077651277 Sep 13 07:11:54.649180 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 99bbe5cbd59f4feda4da45f2b14bd09b Sep 13 07:11:54.649180 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-TestVolumeBootPattern-2077651277 Sep 13 07:11:54.649180 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-TestVolumeBootPattern-2077651277-project Sep 13 07:11:54.649180 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:11:54.649180 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:11:54.649180 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 67fa873d16414749bc478a59de3ec5b4 Sep 13 07:11:54.649180 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-TestVolumeBootPattern-2077651277-project Sep 13 07:11:54.649180 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:11:54.649180 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 could not be found. Sep 13 07:11:54.649180 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': 'df5f6f23-54e8-43b0-a5a3-6e336b2a3582'} Sep 13 07:11:54.649990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:11:54.649990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:54.649990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:11:54.649990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:11:54.649990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:11:54.649990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:11:54.649990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:11:54.649990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:11:54.649990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:11:54.649990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:11:54.649990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 could not be found. Sep 13 07:11:54.649990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:54.649990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:54.649990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:54.649990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:54.649990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:54.649990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:54.649990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:11:54.649990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:11:54.649990 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:11:54.651428 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:11:54.651428 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:11:54.651428 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:11:54.651428 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:11:54.651428 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:11:54.651428 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:11:54.651428 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:11:54.651428 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 could not be found. Sep 13 07:11:54.651428 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:54.651428 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:11:54.651428 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:54.651428 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:11:54.651428 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:11:54.651428 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:11:54.651428 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:11:54.651428 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:11:54.651428 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 could not be found. Sep 13 07:11:54.651428 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:11:54.652749 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9fd82792-8e42-4370-855e-369d019f919f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Returning 404 to user: Instance df5f6f23-54e8-43b0-a5a3-6e336b2a3582 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:11:54.652749 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9fd82792-8e42-4370-855e-369d019f919f tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582" status: 404 len: 111 microversion: 2.1 time: 0.030809 Sep 13 07:11:54.652749 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 551/1068] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:11:54 2022] GET /compute/v2.1/servers/df5f6f23-54e8-43b0-a5a3-6e336b2a3582 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:11:55.957382 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-cdbbc929-7ca5-4844-bce6-cb77c40d7f29 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] Calling method '.version_select at 0x7f4c195c8d30>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:11:55.980099 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-cdbbc929-7ca5-4844-bce6-cb77c40d7f29 tempest-TestVolumeBootPattern-2077651277 tempest-TestVolumeBootPattern-2077651277-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-206741384" status: 202 len: 0 microversion: 2.1 time: 0.026598 Sep 13 07:11:55.980702 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 518/1069] 10.222.0.25 () {58 vars in 1260 bytes} [Tue Sep 13 07:11:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-206741384 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:11:59.151645 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a7b633f1-9a54-4cd8-a1f3-bccb65a79389 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2069516425", "imageRef": "19a6700e-e153-4bea-87aa-036bfccf0ecd", "flavorRef": "452", "networks": [{"uuid": "09f8ffa0-4e9e-4146-8a2e-d84023e00d7a"}]}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:11:59.209326 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-a7b633f1-9a54-4cd8-a1f3-bccb65a79389 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] validate_networks() for [('09f8ffa0-4e9e-4146-8a2e-d84023e00d7a', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:12:00.080638 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-a7b633f1-9a54-4cd8-a1f3-bccb65a79389 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:12:00.081048 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-a7b633f1-9a54-4cd8-a1f3-bccb65a79389 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:12:00.081533 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-a7b633f1-9a54-4cd8-a1f3-bccb65a79389 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:12:00.081933 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-a7b633f1-9a54-4cd8-a1f3-bccb65a79389 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:12:00.082346 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-a7b633f1-9a54-4cd8-a1f3-bccb65a79389 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:12:00.092526 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7b633f1-9a54-4cd8-a1f3-bccb65a79389 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:00.093354 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7b633f1-9a54-4cd8-a1f3-bccb65a79389 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:00.093720 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7b633f1-9a54-4cd8-a1f3-bccb65a79389 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:00.094650 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7b633f1-9a54-4cd8-a1f3-bccb65a79389 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:00.095076 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7b633f1-9a54-4cd8-a1f3-bccb65a79389 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:00.095693 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7b633f1-9a54-4cd8-a1f3-bccb65a79389 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:00.113037 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-a7b633f1-9a54-4cd8-a1f3-bccb65a79389 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Getting quotas for project bfd6c0d2b084418483a72536fbb6716a. Resources: {'instances', 'cores', 'ram'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:12:00.117000 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-a7b633f1-9a54-4cd8-a1f3-bccb65a79389 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Getting quotas for user 97914dfbd4994558a3df3c3d6fb645f5 and project bfd6c0d2b084418483a72536fbb6716a. Resources: {'instances', 'cores', 'ram'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:12:00.128010 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a7b633f1-9a54-4cd8-a1f3-bccb65a79389 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:12:00.130355 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a7b633f1-9a54-4cd8-a1f3-bccb65a79389 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 71d689e4-41b3-4ecf-a9a3-41055d62ce4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='19a6700e-e153-4bea-87aa-036bfccf0ecd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:12:00.189058 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a7b633f1-9a54-4cd8-a1f3-bccb65a79389 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.041310 Sep 13 07:12:00.190694 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 552/1070] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Sep 13 07:11:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 07:12:00.202196 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ca2190f3-0009-4f07-a708-0e91c51acb4a tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:12:00.203465 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ca2190f3-0009-4f07-a708-0e91c51acb4a tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 71d689e4-41b3-4ecf-a9a3-41055d62ce4d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:12:00.275959 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ca2190f3-0009-4f07-a708-0e91c51acb4a tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:12:00.283105 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ca2190f3-0009-4f07-a708-0e91c51acb4a tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d" status: 200 len: 1219 microversion: 2.1 time: 0.085247 Sep 13 07:12:00.283773 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 519/1071] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:12:00 2022] GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:12:01.307440 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-12a90b32-3ba2-478b-944a-b89c7462804a tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:12:01.308007 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-12a90b32-3ba2-478b-944a-b89c7462804a tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 71d689e4-41b3-4ecf-a9a3-41055d62ce4d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:12:01.314916 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12a90b32-3ba2-478b-944a-b89c7462804a tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:01.315402 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12a90b32-3ba2-478b-944a-b89c7462804a tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:01.315815 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12a90b32-3ba2-478b-944a-b89c7462804a tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:01.316582 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12a90b32-3ba2-478b-944a-b89c7462804a tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:01.317190 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12a90b32-3ba2-478b-944a-b89c7462804a tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:01.317608 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12a90b32-3ba2-478b-944a-b89c7462804a tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:01.383424 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-12a90b32-3ba2-478b-944a-b89c7462804a tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:12:01.393031 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-12a90b32-3ba2-478b-944a-b89c7462804a tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d" status: 200 len: 1271 microversion: 2.1 time: 0.090282 Sep 13 07:12:01.393630 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 553/1072] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:12:01 2022] GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:12:02.418555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-82380fe3-e1b0-4456-a2cc-f86dccc673ee tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:12:02.420461 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-82380fe3-e1b0-4456-a2cc-f86dccc673ee tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 71d689e4-41b3-4ecf-a9a3-41055d62ce4d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:12:02.431701 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82380fe3-e1b0-4456-a2cc-f86dccc673ee tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:02.432169 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82380fe3-e1b0-4456-a2cc-f86dccc673ee tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:02.432599 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82380fe3-e1b0-4456-a2cc-f86dccc673ee tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:02.433307 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82380fe3-e1b0-4456-a2cc-f86dccc673ee tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:02.435464 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82380fe3-e1b0-4456-a2cc-f86dccc673ee tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:02.435918 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82380fe3-e1b0-4456-a2cc-f86dccc673ee tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:02.653110 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-82380fe3-e1b0-4456-a2cc-f86dccc673ee tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:12:02.665381 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-82380fe3-e1b0-4456-a2cc-f86dccc673ee tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d" status: 200 len: 1319 microversion: 2.1 time: 0.252356 Sep 13 07:12:02.667179 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 520/1073] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:12:02 2022] GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:12:03.087714 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-a1bde9f0-ace6-46fe-bf7b-87608992999f req-fffe283a-0259-4b18-947c-dbf5136e381c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71d689e4-41b3-4ecf-a9a3-41055d62ce4d", "tag": "1fc85e98-d127-4735-a8f6-e4f21d4316c6"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:12:03.113995 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-a1bde9f0-ace6-46fe-bf7b-87608992999f req-fffe283a-0259-4b18-947c-dbf5136e381c service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:03.114787 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-a1bde9f0-ace6-46fe-bf7b-87608992999f req-fffe283a-0259-4b18-947c-dbf5136e381c service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:03.115223 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-a1bde9f0-ace6-46fe-bf7b-87608992999f req-fffe283a-0259-4b18-947c-dbf5136e381c service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:03.127396 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-a1bde9f0-ace6-46fe-bf7b-87608992999f req-fffe283a-0259-4b18-947c-dbf5136e381c service nova] Creating event network-changed:1fc85e98-d127-4735-a8f6-e4f21d4316c6 for instance 71d689e4-41b3-4ecf-a9a3-41055d62ce4d on hv-cinder-85694 Sep 13 07:12:03.133278 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-a1bde9f0-ace6-46fe-bf7b-87608992999f req-fffe283a-0259-4b18-947c-dbf5136e381c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051242 Sep 13 07:12:03.134228 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 554/1074] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:12:03.688766 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-383f5d2c-3754-41d4-8f76-30bf666c652f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:12:03.689377 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-383f5d2c-3754-41d4-8f76-30bf666c652f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 71d689e4-41b3-4ecf-a9a3-41055d62ce4d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:12:03.695740 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-383f5d2c-3754-41d4-8f76-30bf666c652f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:03.696219 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-383f5d2c-3754-41d4-8f76-30bf666c652f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:03.696637 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-383f5d2c-3754-41d4-8f76-30bf666c652f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:03.698220 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-383f5d2c-3754-41d4-8f76-30bf666c652f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:03.698727 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-383f5d2c-3754-41d4-8f76-30bf666c652f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:03.699152 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-383f5d2c-3754-41d4-8f76-30bf666c652f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:03.832468 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-383f5d2c-3754-41d4-8f76-30bf666c652f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:12:03.840434 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-383f5d2c-3754-41d4-8f76-30bf666c652f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d" status: 200 len: 1319 microversion: 2.1 time: 0.155559 Sep 13 07:12:03.841034 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 521/1075] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:12:03 2022] GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:12:04.864187 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f1b47cc6-812b-4fe1-a869-e65e387328b2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:12:04.864902 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f1b47cc6-812b-4fe1-a869-e65e387328b2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 71d689e4-41b3-4ecf-a9a3-41055d62ce4d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:12:04.866928 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:12:04.873082 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f1b47cc6-812b-4fe1-a869-e65e387328b2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:04.873633 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f1b47cc6-812b-4fe1-a869-e65e387328b2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:04.874100 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f1b47cc6-812b-4fe1-a869-e65e387328b2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:04.874780 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f1b47cc6-812b-4fe1-a869-e65e387328b2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:04.875216 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f1b47cc6-812b-4fe1-a869-e65e387328b2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:04.875626 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f1b47cc6-812b-4fe1-a869-e65e387328b2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:05.007519 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f1b47cc6-812b-4fe1-a869-e65e387328b2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:12:05.015991 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f1b47cc6-812b-4fe1-a869-e65e387328b2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d" status: 200 len: 1319 microversion: 2.1 time: 0.156546 Sep 13 07:12:05.016566 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 555/1076] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:12:04 2022] GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:12:06.046179 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7a08b6e3-3e69-45f3-8a3e-f6be44e79987 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:12:06.047154 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7a08b6e3-3e69-45f3-8a3e-f6be44e79987 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 71d689e4-41b3-4ecf-a9a3-41055d62ce4d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:12:06.051182 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:12:06.060822 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7a08b6e3-3e69-45f3-8a3e-f6be44e79987 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:06.061612 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7a08b6e3-3e69-45f3-8a3e-f6be44e79987 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:06.062385 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7a08b6e3-3e69-45f3-8a3e-f6be44e79987 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:06.063507 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7a08b6e3-3e69-45f3-8a3e-f6be44e79987 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:06.064291 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7a08b6e3-3e69-45f3-8a3e-f6be44e79987 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:06.064983 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7a08b6e3-3e69-45f3-8a3e-f6be44e79987 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:06.207388 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7a08b6e3-3e69-45f3-8a3e-f6be44e79987 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:12:06.215686 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7a08b6e3-3e69-45f3-8a3e-f6be44e79987 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d" status: 200 len: 1319 microversion: 2.1 time: 0.176567 Sep 13 07:12:06.216230 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 522/1077] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:12:06 2022] GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:12:07.248541 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3f5df940-97d9-4947-a6d2-8448e3e43ebd tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:12:07.249139 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3f5df940-97d9-4947-a6d2-8448e3e43ebd tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 71d689e4-41b3-4ecf-a9a3-41055d62ce4d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:12:07.255778 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f5df940-97d9-4947-a6d2-8448e3e43ebd tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:07.256240 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f5df940-97d9-4947-a6d2-8448e3e43ebd tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:07.256671 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f5df940-97d9-4947-a6d2-8448e3e43ebd tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:07.257368 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f5df940-97d9-4947-a6d2-8448e3e43ebd tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:07.257821 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f5df940-97d9-4947-a6d2-8448e3e43ebd tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:07.258285 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f5df940-97d9-4947-a6d2-8448e3e43ebd tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:07.261264 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:12:07.412315 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3f5df940-97d9-4947-a6d2-8448e3e43ebd tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:12:07.420113 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3f5df940-97d9-4947-a6d2-8448e3e43ebd tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d" status: 200 len: 1319 microversion: 2.1 time: 0.175658 Sep 13 07:12:07.420979 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 556/1078] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:12:07 2022] GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:12:08.444363 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-15366504-b036-40ae-8fd2-e96929df35b7 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:12:08.445075 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-15366504-b036-40ae-8fd2-e96929df35b7 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 71d689e4-41b3-4ecf-a9a3-41055d62ce4d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:12:08.453128 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-15366504-b036-40ae-8fd2-e96929df35b7 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:08.453669 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-15366504-b036-40ae-8fd2-e96929df35b7 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:08.454218 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-15366504-b036-40ae-8fd2-e96929df35b7 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:08.455002 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-15366504-b036-40ae-8fd2-e96929df35b7 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:08.455498 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-15366504-b036-40ae-8fd2-e96929df35b7 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:08.455966 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-15366504-b036-40ae-8fd2-e96929df35b7 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:08.589791 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-15366504-b036-40ae-8fd2-e96929df35b7 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:12:08.597912 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-15366504-b036-40ae-8fd2-e96929df35b7 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d" status: 200 len: 1319 microversion: 2.1 time: 0.157887 Sep 13 07:12:08.598589 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 523/1079] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:12:08 2022] GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:12:09.366463 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-746f6f03-766e-4706-a14d-d2c25bd864f6 req-115cbad0-f6ab-49c3-b6fc-adf2fabc2e1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71d689e4-41b3-4ecf-a9a3-41055d62ce4d", "name": "network-vif-plugged", "status": "completed", "tag": "1fc85e98-d127-4735-a8f6-e4f21d4316c6"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:12:09.376149 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-746f6f03-766e-4706-a14d-d2c25bd864f6 req-115cbad0-f6ab-49c3-b6fc-adf2fabc2e1f service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:09.376619 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-746f6f03-766e-4706-a14d-d2c25bd864f6 req-115cbad0-f6ab-49c3-b6fc-adf2fabc2e1f service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:09.377042 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-746f6f03-766e-4706-a14d-d2c25bd864f6 req-115cbad0-f6ab-49c3-b6fc-adf2fabc2e1f service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:09.388078 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-746f6f03-766e-4706-a14d-d2c25bd864f6 req-115cbad0-f6ab-49c3-b6fc-adf2fabc2e1f service nova] Creating event network-vif-plugged:1fc85e98-d127-4735-a8f6-e4f21d4316c6 for instance 71d689e4-41b3-4ecf-a9a3-41055d62ce4d on hv-cinder-85694 Sep 13 07:12:09.392957 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-746f6f03-766e-4706-a14d-d2c25bd864f6 req-115cbad0-f6ab-49c3-b6fc-adf2fabc2e1f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213333 Sep 13 07:12:09.393752 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 557/1080] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:12:09.621459 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a10ef717-883e-450f-ac65-836c3da220d2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:12:09.622129 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a10ef717-883e-450f-ac65-836c3da220d2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 71d689e4-41b3-4ecf-a9a3-41055d62ce4d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:12:09.629400 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a10ef717-883e-450f-ac65-836c3da220d2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:09.629887 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a10ef717-883e-450f-ac65-836c3da220d2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:09.630356 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a10ef717-883e-450f-ac65-836c3da220d2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:09.631054 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a10ef717-883e-450f-ac65-836c3da220d2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:09.631499 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a10ef717-883e-450f-ac65-836c3da220d2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:09.631934 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a10ef717-883e-450f-ac65-836c3da220d2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:09.763795 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a10ef717-883e-450f-ac65-836c3da220d2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:12:09.771928 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a10ef717-883e-450f-ac65-836c3da220d2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d" status: 200 len: 1319 microversion: 2.1 time: 0.155037 Sep 13 07:12:09.772494 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 524/1081] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:12:09 2022] GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:12:10.797487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:12:10.798304 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=6 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:12:10.803290 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-20d0c6bc-b8a2-4d2e-9b84-bda7801331e8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:12:10.803967 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-20d0c6bc-b8a2-4d2e-9b84-bda7801331e8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 71d689e4-41b3-4ecf-a9a3-41055d62ce4d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:12:10.811936 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-20d0c6bc-b8a2-4d2e-9b84-bda7801331e8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:10.812431 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-20d0c6bc-b8a2-4d2e-9b84-bda7801331e8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:10.812849 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-20d0c6bc-b8a2-4d2e-9b84-bda7801331e8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:10.813540 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-20d0c6bc-b8a2-4d2e-9b84-bda7801331e8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:10.813995 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-20d0c6bc-b8a2-4d2e-9b84-bda7801331e8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:10.814448 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-20d0c6bc-b8a2-4d2e-9b84-bda7801331e8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:10.957579 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-20d0c6bc-b8a2-4d2e-9b84-bda7801331e8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:12:10.966347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-20d0c6bc-b8a2-4d2e-9b84-bda7801331e8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d" status: 200 len: 1319 microversion: 2.1 time: 0.169738 Sep 13 07:12:10.966841 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 558/1082] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:12:10 2022] GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:12:11.993539 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-438709e9-b546-4790-9970-0b660f102c5e tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:12:11.994498 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-438709e9-b546-4790-9970-0b660f102c5e tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 71d689e4-41b3-4ecf-a9a3-41055d62ce4d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:12:11.997440 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:12:12.007495 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-438709e9-b546-4790-9970-0b660f102c5e tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:12.008296 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-438709e9-b546-4790-9970-0b660f102c5e tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:12.009017 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-438709e9-b546-4790-9970-0b660f102c5e tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:12.010380 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-438709e9-b546-4790-9970-0b660f102c5e tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:12.011004 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-438709e9-b546-4790-9970-0b660f102c5e tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:12.011321 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-438709e9-b546-4790-9970-0b660f102c5e tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:12.014132 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=72 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:12:12.159561 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-438709e9-b546-4790-9970-0b660f102c5e tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:12:12.168209 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-438709e9-b546-4790-9970-0b660f102c5e tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d" status: 200 len: 1507 microversion: 2.1 time: 0.181405 Sep 13 07:12:12.168827 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 525/1083] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:12:11 2022] GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:12:26.443368 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e35d5dc1-2d49-4c54-899d-0f384a69f37c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f6c6645-ef34-423e-b15a-6e81b799d1e1", "device": "/dev/sdb"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:12:26.446545 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e35d5dc1-2d49-4c54-899d-0f384a69f37c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 71d689e4-41b3-4ecf-a9a3-41055d62ce4d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:12:26.448804 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=7 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:12:26.449636 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=13 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:12:26.455230 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e35d5dc1-2d49-4c54-899d-0f384a69f37c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:26.455701 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e35d5dc1-2d49-4c54-899d-0f384a69f37c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:26.456135 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e35d5dc1-2d49-4c54-899d-0f384a69f37c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:26.456835 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e35d5dc1-2d49-4c54-899d-0f384a69f37c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:26.457286 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e35d5dc1-2d49-4c54-899d-0f384a69f37c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:26.457730 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e35d5dc1-2d49-4c54-899d-0f384a69f37c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:26.752488 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e35d5dc1-2d49-4c54-899d-0f384a69f37c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "POST /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312993 Sep 13 07:12:26.753110 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 559/1084] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Sep 13 07:12:26 2022] POST /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:12:49.676220 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e75b8ead-3ece-4d1b-b333-bea6036e9158 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:12:49.676806 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e75b8ead-3ece-4d1b-b333-bea6036e9158 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 71d689e4-41b3-4ecf-a9a3-41055d62ce4d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:12:49.679420 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=7 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:12:49.680086 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=5 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:12:49.687690 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e75b8ead-3ece-4d1b-b333-bea6036e9158 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:49.688167 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e75b8ead-3ece-4d1b-b333-bea6036e9158 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:49.688591 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e75b8ead-3ece-4d1b-b333-bea6036e9158 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:49.689275 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e75b8ead-3ece-4d1b-b333-bea6036e9158 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:49.689712 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e75b8ead-3ece-4d1b-b333-bea6036e9158 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:49.690150 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e75b8ead-3ece-4d1b-b333-bea6036e9158 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:49.784849 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-e75b8ead-3ece-4d1b-b333-bea6036e9158 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lazy-loading 'services' on Instance uuid 71d689e4-41b3-4ecf-a9a3-41055d62ce4d {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:12:49.871095 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e75b8ead-3ece-4d1b-b333-bea6036e9158 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "DELETE /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d/os-volume_attachments/5f6c6645-ef34-423e-b15a-6e81b799d1e1" status: 202 len: 0 microversion: 2.1 time: 0.201011 Sep 13 07:12:49.871826 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 526/1085] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Sep 13 07:12:49 2022] DELETE /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d/os-volume_attachments/5f6c6645-ef34-423e-b15a-6e81b799d1e1 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:12:51.021471 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:12:51.022292 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:12:51.027011 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f0d6ef8a-3622-4ac4-b0e7-6b60632c7eba tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:12:51.027688 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f0d6ef8a-3622-4ac4-b0e7-6b60632c7eba tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 71d689e4-41b3-4ecf-a9a3-41055d62ce4d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:12:51.035773 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0d6ef8a-3622-4ac4-b0e7-6b60632c7eba tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:51.036256 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0d6ef8a-3622-4ac4-b0e7-6b60632c7eba tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:51.036691 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0d6ef8a-3622-4ac4-b0e7-6b60632c7eba tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:51.037385 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0d6ef8a-3622-4ac4-b0e7-6b60632c7eba tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:51.037836 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0d6ef8a-3622-4ac4-b0e7-6b60632c7eba tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:51.038324 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0d6ef8a-3622-4ac4-b0e7-6b60632c7eba tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:51.065467 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f0d6ef8a-3622-4ac4-b0e7-6b60632c7eba tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 71d689e4-41b3-4ecf-a9a3-41055d62ce4d] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:12:51.146119 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f0d6ef8a-3622-4ac4-b0e7-6b60632c7eba tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "DELETE /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d" status: 204 len: 0 microversion: 2.1 time: 0.125781 Sep 13 07:12:51.146753 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 560/1086] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:12:51 2022] DELETE /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:12:51.157216 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-112c6ce2-d10b-4089-a533-2f1258961288 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:12:51.158814 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-112c6ce2-d10b-4089-a533-2f1258961288 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 71d689e4-41b3-4ecf-a9a3-41055d62ce4d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:12:51.165231 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-112c6ce2-d10b-4089-a533-2f1258961288 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:51.165711 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-112c6ce2-d10b-4089-a533-2f1258961288 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:51.166187 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-112c6ce2-d10b-4089-a533-2f1258961288 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:51.166878 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-112c6ce2-d10b-4089-a533-2f1258961288 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:51.167330 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-112c6ce2-d10b-4089-a533-2f1258961288 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:51.167752 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-112c6ce2-d10b-4089-a533-2f1258961288 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:51.308310 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-112c6ce2-d10b-4089-a533-2f1258961288 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:12:51.317156 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-112c6ce2-d10b-4089-a533-2f1258961288 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d" status: 200 len: 1513 microversion: 2.1 time: 0.165024 Sep 13 07:12:51.317654 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 527/1087] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:12:51 2022] GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:12:52.345661 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e204179d-6559-4152-928b-12e4b08c4e89 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:12:52.346857 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e204179d-6559-4152-928b-12e4b08c4e89 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 71d689e4-41b3-4ecf-a9a3-41055d62ce4d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:12:52.357651 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e204179d-6559-4152-928b-12e4b08c4e89 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:52.358130 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e204179d-6559-4152-928b-12e4b08c4e89 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:52.358876 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e204179d-6559-4152-928b-12e4b08c4e89 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:52.359575 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e204179d-6559-4152-928b-12e4b08c4e89 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:52.360027 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e204179d-6559-4152-928b-12e4b08c4e89 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:52.360446 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e204179d-6559-4152-928b-12e4b08c4e89 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:52.501227 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e204179d-6559-4152-928b-12e4b08c4e89 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:12:52.513686 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e204179d-6559-4152-928b-12e4b08c4e89 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d" status: 200 len: 1513 microversion: 2.1 time: 0.174916 Sep 13 07:12:52.514286 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 561/1088] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:12:52 2022] GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:12:53.436686 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-4dbea71e-9e43-4603-8992-baa34ee37c6d req-de30b939-fca1-403c-b4da-b6c1c6d58c96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71d689e4-41b3-4ecf-a9a3-41055d62ce4d", "name": "network-vif-deleted", "tag": "1fc85e98-d127-4735-a8f6-e4f21d4316c6"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:12:53.446270 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-4dbea71e-9e43-4603-8992-baa34ee37c6d req-de30b939-fca1-403c-b4da-b6c1c6d58c96 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:53.446746 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-4dbea71e-9e43-4603-8992-baa34ee37c6d req-de30b939-fca1-403c-b4da-b6c1c6d58c96 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:53.447168 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-4dbea71e-9e43-4603-8992-baa34ee37c6d req-de30b939-fca1-403c-b4da-b6c1c6d58c96 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:53.458390 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-4dbea71e-9e43-4603-8992-baa34ee37c6d req-de30b939-fca1-403c-b4da-b6c1c6d58c96 service nova] Creating event network-vif-deleted:1fc85e98-d127-4735-a8f6-e4f21d4316c6 for instance 71d689e4-41b3-4ecf-a9a3-41055d62ce4d on hv-cinder-85694 Sep 13 07:12:53.463063 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-4dbea71e-9e43-4603-8992-baa34ee37c6d req-de30b939-fca1-403c-b4da-b6c1c6d58c96 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094042 Sep 13 07:12:53.463653 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 528/1089] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:12:53.536487 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bc8c0da5-1463-44a3-9d85-761cfa0b1869 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:12:53.537235 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bc8c0da5-1463-44a3-9d85-761cfa0b1869 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 71d689e4-41b3-4ecf-a9a3-41055d62ce4d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:12:53.544190 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc8c0da5-1463-44a3-9d85-761cfa0b1869 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:53.544686 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc8c0da5-1463-44a3-9d85-761cfa0b1869 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:53.545672 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc8c0da5-1463-44a3-9d85-761cfa0b1869 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:53.546166 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc8c0da5-1463-44a3-9d85-761cfa0b1869 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:53.546597 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc8c0da5-1463-44a3-9d85-761cfa0b1869 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:53.547215 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc8c0da5-1463-44a3-9d85-761cfa0b1869 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:53.579347 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc8c0da5-1463-44a3-9d85-761cfa0b1869 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:53.579820 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc8c0da5-1463-44a3-9d85-761cfa0b1869 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:53.580240 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc8c0da5-1463-44a3-9d85-761cfa0b1869 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:53.580674 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-bc8c0da5-1463-44a3-9d85-761cfa0b1869 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lazy-loading 'fault' on Instance uuid 71d689e4-41b3-4ecf-a9a3-41055d62ce4d {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:12:53.625979 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bc8c0da5-1463-44a3-9d85-761cfa0b1869 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:12:53.637323 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bc8c0da5-1463-44a3-9d85-761cfa0b1869 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d" status: 200 len: 1309 microversion: 2.1 time: 0.104537 Sep 13 07:12:53.637863 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 562/1090] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:12:53 2022] GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:12:54.659307 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 07:12:54.659836 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Tue Sep 13 07:12:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d (ip 10.222.0.25) !!! Sep 13 07:12:54.665544 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-63e9fde8-5738-47c2-a9d9-70a4de78128b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:12:54.666277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-63e9fde8-5738-47c2-a9d9-70a4de78128b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 71d689e4-41b3-4ecf-a9a3-41055d62ce4d] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:12:54.674607 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-63e9fde8-5738-47c2-a9d9-70a4de78128b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:54.675094 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-63e9fde8-5738-47c2-a9d9-70a4de78128b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:54.675543 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-63e9fde8-5738-47c2-a9d9-70a4de78128b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:54.676235 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-63e9fde8-5738-47c2-a9d9-70a4de78128b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:12:54.676683 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-63e9fde8-5738-47c2-a9d9-70a4de78128b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:12:54.677102 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-63e9fde8-5738-47c2-a9d9-70a4de78128b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:12:54.692016 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-63e9fde8-5738-47c2-a9d9-70a4de78128b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] HTTP exception thrown: Instance 71d689e4-41b3-4ecf-a9a3-41055d62ce4d could not be found. Sep 13 07:12:54.693648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-63e9fde8-5738-47c2-a9d9-70a4de78128b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Request method failure captured: Sep 13 07:12:54.693648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d HTTP/1.1 Sep 13 07:12:54.693648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 13 07:12:54.693648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 13 07:12:54.693648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Connection: close Sep 13 07:12:54.693648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 13 07:12:54.693648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 13 07:12:54.693648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Host: 10.222.0.25 Sep 13 07:12:54.693648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 13 07:12:54.693648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 13 07:12:54.693648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjIC09Pbc4CyDfaZr3-MGTI7Dqqu1u5Xa8AdOOy1avRfGi4LmaFz76ehe4rbilrNV_eJfP6aMGErLho4Tmy00FxVYc0Ql5kcd7EW_oqx5UGrNNwpXIy6fXhKUtTr-dWYSO_YPpknBbIQR23iC-rl3uDeVYcla9rvEcNoKibu5WwkKPqtc Sep 13 07:12:54.693648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 13 07:12:54.693648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 13 07:12:54.693648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 13 07:12:54.693648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 13 07:12:54.693648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 13 07:12:54.693648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 13 07:12:54.693648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Id: bfd6c0d2b084418483a72536fbb6716a Sep 13 07:12:54.693648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1055383426 Sep 13 07:12:54.693648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Role: reader,member Sep 13 07:12:54.693648 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Roles: reader,member Sep 13 07:12:54.695421 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bfd6c0d2b084418483a72536fbb6716a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bfd6c0d2b084418483a72536fbb6716a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bfd6c0d2b084418483a72536fbb6716a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bfd6c0d2b084418483a72536fbb6716a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:12:54.695421 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-VolumesSnapshotTestJSON-1055383426 Sep 13 07:12:54.695421 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Id: bfd6c0d2b084418483a72536fbb6716a Sep 13 07:12:54.695421 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1055383426 Sep 13 07:12:54.695421 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User: tempest-VolumesSnapshotTestJSON-1055383426-project Sep 13 07:12:54.695421 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 13 07:12:54.695421 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 13 07:12:54.695421 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Id: 97914dfbd4994558a3df3c3d6fb645f5 Sep 13 07:12:54.695421 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-VolumesSnapshotTestJSON-1055383426-project Sep 13 07:12:54.695421 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: method: > Sep 13 07:12:54.695421 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: exception: Instance 71d689e4-41b3-4ecf-a9a3-41055d62ce4d could not be found. Sep 13 07:12:54.695421 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: action_args: {'id': '71d689e4-41b3-4ecf-a9a3-41055d62ce4d'} Sep 13 07:12:54.696555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:12:54.696555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:12:54.696555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:12:54.696555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:12:54.696555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:12:54.696555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:12:54.696555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:12:54.696555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:12:54.696555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:12:54.696555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:12:54.696555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71d689e4-41b3-4ecf-a9a3-41055d62ce4d could not be found. Sep 13 07:12:54.696555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:12:54.696555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:12:54.696555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:12:54.696555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:12:54.696555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:12:54.696555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:12:54.696555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:12:54.696555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:12:54.696555 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:12:54.698419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:12:54.698419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:12:54.698419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:12:54.698419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:12:54.698419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:12:54.698419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:12:54.698419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:12:54.698419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71d689e4-41b3-4ecf-a9a3-41055d62ce4d could not be found. Sep 13 07:12:54.698419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:12:54.698419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:12:54.698419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:12:54.698419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:12:54.698419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:12:54.698419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:12:54.698419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:12:54.698419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:12:54.698419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71d689e4-41b3-4ecf-a9a3-41055d62ce4d could not be found. Sep 13 07:12:54.698419 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 13 07:12:54.700860 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-63e9fde8-5738-47c2-a9d9-70a4de78128b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Returning 404 to user: Instance 71d689e4-41b3-4ecf-a9a3-41055d62ce4d could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:12:54.700860 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-63e9fde8-5738-47c2-a9d9-70a4de78128b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d" status: 404 len: 111 microversion: 2.1 time: 0.038153 Sep 13 07:12:54.700860 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 529/1091] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:12:54 2022] GET /compute/v2.1/servers/71d689e4-41b3-4ecf-a9a3-41055d62ce4d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:13:02.633675 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-57943bbd-cd1d-40e3-b575-0d46152a810b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1728707396", "imageRef": "19a6700e-e153-4bea-87aa-036bfccf0ecd", "flavorRef": "452", "networks": [{"uuid": "09f8ffa0-4e9e-4146-8a2e-d84023e00d7a"}]}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:13:02.698111 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-57943bbd-cd1d-40e3-b575-0d46152a810b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] validate_networks() for [('09f8ffa0-4e9e-4146-8a2e-d84023e00d7a', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:13:03.063844 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-57943bbd-cd1d-40e3-b575-0d46152a810b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:13:03.064265 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-57943bbd-cd1d-40e3-b575-0d46152a810b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:13:03.064734 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-57943bbd-cd1d-40e3-b575-0d46152a810b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:13:03.065146 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-57943bbd-cd1d-40e3-b575-0d46152a810b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:13:03.065552 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-57943bbd-cd1d-40e3-b575-0d46152a810b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:13:03.074696 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57943bbd-cd1d-40e3-b575-0d46152a810b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:03.075181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57943bbd-cd1d-40e3-b575-0d46152a810b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:03.075610 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57943bbd-cd1d-40e3-b575-0d46152a810b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:03.076336 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57943bbd-cd1d-40e3-b575-0d46152a810b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:03.076780 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57943bbd-cd1d-40e3-b575-0d46152a810b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:03.077198 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57943bbd-cd1d-40e3-b575-0d46152a810b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:03.094062 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-57943bbd-cd1d-40e3-b575-0d46152a810b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Getting quotas for project bfd6c0d2b084418483a72536fbb6716a. Resources: {'instances', 'cores', 'ram'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:13:03.098464 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-57943bbd-cd1d-40e3-b575-0d46152a810b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Getting quotas for user 97914dfbd4994558a3df3c3d6fb645f5 and project bfd6c0d2b084418483a72536fbb6716a. Resources: {'instances', 'cores', 'ram'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:13:03.109737 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-57943bbd-cd1d-40e3-b575-0d46152a810b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:13:03.112086 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-57943bbd-cd1d-40e3-b575-0d46152a810b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 740fece7-c255-464c-9d25-88aa623b0e7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='19a6700e-e153-4bea-87aa-036bfccf0ecd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:13:03.158457 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-57943bbd-cd1d-40e3-b575-0d46152a810b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531888 Sep 13 07:13:03.159108 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 563/1092] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Sep 13 07:13:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 07:13:03.170771 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d873751f-3100-4077-8dbe-8181ba338e79 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:13:03.171386 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d873751f-3100-4077-8dbe-8181ba338e79 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 740fece7-c255-464c-9d25-88aa623b0e7b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:13:03.225606 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d873751f-3100-4077-8dbe-8181ba338e79 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:13:03.232552 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d873751f-3100-4077-8dbe-8181ba338e79 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b" status: 200 len: 1219 microversion: 2.1 time: 0.065905 Sep 13 07:13:03.233120 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 530/1093] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:13:03 2022] GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:13:04.256238 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5e28d7cb-fb27-4b55-815f-3b11a1c4ecfd tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:13:04.256840 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5e28d7cb-fb27-4b55-815f-3b11a1c4ecfd tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 740fece7-c255-464c-9d25-88aa623b0e7b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:13:04.267387 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e28d7cb-fb27-4b55-815f-3b11a1c4ecfd tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:04.267830 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e28d7cb-fb27-4b55-815f-3b11a1c4ecfd tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:04.268291 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e28d7cb-fb27-4b55-815f-3b11a1c4ecfd tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:04.269151 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e28d7cb-fb27-4b55-815f-3b11a1c4ecfd tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:04.269616 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e28d7cb-fb27-4b55-815f-3b11a1c4ecfd tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:04.270160 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e28d7cb-fb27-4b55-815f-3b11a1c4ecfd tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:04.355719 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5e28d7cb-fb27-4b55-815f-3b11a1c4ecfd tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:13:04.366138 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5e28d7cb-fb27-4b55-815f-3b11a1c4ecfd tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b" status: 200 len: 1279 microversion: 2.1 time: 0.114504 Sep 13 07:13:04.366825 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 564/1094] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:13:04 2022] GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b => generated 1279 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:13:05.390447 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-cd59956b-0d4e-4b55-b14a-35ce1e40837b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:13:05.391040 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-cd59956b-0d4e-4b55-b14a-35ce1e40837b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 740fece7-c255-464c-9d25-88aa623b0e7b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:13:05.394362 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:13:05.401527 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cd59956b-0d4e-4b55-b14a-35ce1e40837b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:05.402030 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cd59956b-0d4e-4b55-b14a-35ce1e40837b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:05.402473 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cd59956b-0d4e-4b55-b14a-35ce1e40837b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:05.403197 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cd59956b-0d4e-4b55-b14a-35ce1e40837b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:05.403635 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cd59956b-0d4e-4b55-b14a-35ce1e40837b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:05.404046 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cd59956b-0d4e-4b55-b14a-35ce1e40837b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:05.606171 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-cd59956b-0d4e-4b55-b14a-35ce1e40837b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:13:05.614795 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-cd59956b-0d4e-4b55-b14a-35ce1e40837b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b" status: 200 len: 1319 microversion: 2.1 time: 0.228115 Sep 13 07:13:05.615353 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 531/1095] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:13:05 2022] GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:13:06.028778 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-52c5e997-6f08-4350-9234-2b54365ebfe0 req-4db48035-9a8d-4f2b-b682-a29e9d810594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "740fece7-c255-464c-9d25-88aa623b0e7b", "tag": "26183801-769d-4ac4-b83f-97bd657971c1"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:13:06.040172 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-52c5e997-6f08-4350-9234-2b54365ebfe0 req-4db48035-9a8d-4f2b-b682-a29e9d810594 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:06.040771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-52c5e997-6f08-4350-9234-2b54365ebfe0 req-4db48035-9a8d-4f2b-b682-a29e9d810594 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:06.041500 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-52c5e997-6f08-4350-9234-2b54365ebfe0 req-4db48035-9a8d-4f2b-b682-a29e9d810594 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:06.052933 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-52c5e997-6f08-4350-9234-2b54365ebfe0 req-4db48035-9a8d-4f2b-b682-a29e9d810594 service nova] Creating event network-changed:26183801-769d-4ac4-b83f-97bd657971c1 for instance 740fece7-c255-464c-9d25-88aa623b0e7b on hv-cinder-85694 Sep 13 07:13:06.058417 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-52c5e997-6f08-4350-9234-2b54365ebfe0 req-4db48035-9a8d-4f2b-b682-a29e9d810594 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034292 Sep 13 07:13:06.059023 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 565/1096] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:13:06.638889 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-cdb37ff4-9911-47c4-ad50-3cc47ebf1750 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:13:06.639488 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-cdb37ff4-9911-47c4-ad50-3cc47ebf1750 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 740fece7-c255-464c-9d25-88aa623b0e7b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:13:06.646531 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cdb37ff4-9911-47c4-ad50-3cc47ebf1750 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:06.647008 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cdb37ff4-9911-47c4-ad50-3cc47ebf1750 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:06.647436 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cdb37ff4-9911-47c4-ad50-3cc47ebf1750 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:06.648154 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cdb37ff4-9911-47c4-ad50-3cc47ebf1750 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:06.648601 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cdb37ff4-9911-47c4-ad50-3cc47ebf1750 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:06.649022 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cdb37ff4-9911-47c4-ad50-3cc47ebf1750 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:06.781509 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-cdb37ff4-9911-47c4-ad50-3cc47ebf1750 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:13:06.789594 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-cdb37ff4-9911-47c4-ad50-3cc47ebf1750 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b" status: 200 len: 1319 microversion: 2.1 time: 0.154752 Sep 13 07:13:06.790197 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 532/1097] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:13:06 2022] GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:13:07.817572 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-65c7b142-d454-484c-a5f2-2ec25c40e23c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:13:07.819181 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-65c7b142-d454-484c-a5f2-2ec25c40e23c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 740fece7-c255-464c-9d25-88aa623b0e7b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:13:07.830256 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65c7b142-d454-484c-a5f2-2ec25c40e23c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:07.831046 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65c7b142-d454-484c-a5f2-2ec25c40e23c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:07.831756 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65c7b142-d454-484c-a5f2-2ec25c40e23c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:07.832921 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65c7b142-d454-484c-a5f2-2ec25c40e23c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:07.833728 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65c7b142-d454-484c-a5f2-2ec25c40e23c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:07.834248 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65c7b142-d454-484c-a5f2-2ec25c40e23c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:07.986263 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-65c7b142-d454-484c-a5f2-2ec25c40e23c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:13:07.994686 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-65c7b142-d454-484c-a5f2-2ec25c40e23c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b" status: 200 len: 1319 microversion: 2.1 time: 0.184311 Sep 13 07:13:07.995250 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 566/1098] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:13:07 2022] GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:13:09.022289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-eb360a88-0def-460d-b8d3-0b1b9fd43f2f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:13:09.023251 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-eb360a88-0def-460d-b8d3-0b1b9fd43f2f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 740fece7-c255-464c-9d25-88aa623b0e7b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:13:09.034300 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eb360a88-0def-460d-b8d3-0b1b9fd43f2f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:09.035109 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eb360a88-0def-460d-b8d3-0b1b9fd43f2f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:09.035825 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eb360a88-0def-460d-b8d3-0b1b9fd43f2f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:09.036800 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eb360a88-0def-460d-b8d3-0b1b9fd43f2f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:09.037279 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eb360a88-0def-460d-b8d3-0b1b9fd43f2f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:09.037700 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eb360a88-0def-460d-b8d3-0b1b9fd43f2f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:09.179013 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-eb360a88-0def-460d-b8d3-0b1b9fd43f2f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:13:09.187246 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-eb360a88-0def-460d-b8d3-0b1b9fd43f2f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b" status: 200 len: 1319 microversion: 2.1 time: 0.171781 Sep 13 07:13:09.187801 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 533/1099] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:13:09 2022] GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:13:10.212389 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e7a8e12a-590b-4ed7-be24-06f5decc4723 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:13:10.213627 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e7a8e12a-590b-4ed7-be24-06f5decc4723 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 740fece7-c255-464c-9d25-88aa623b0e7b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:13:10.220546 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7a8e12a-590b-4ed7-be24-06f5decc4723 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:10.221032 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7a8e12a-590b-4ed7-be24-06f5decc4723 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:10.221493 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7a8e12a-590b-4ed7-be24-06f5decc4723 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:10.222226 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7a8e12a-590b-4ed7-be24-06f5decc4723 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:10.222676 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7a8e12a-590b-4ed7-be24-06f5decc4723 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:10.223095 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7a8e12a-590b-4ed7-be24-06f5decc4723 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:10.358161 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e7a8e12a-590b-4ed7-be24-06f5decc4723 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:13:10.366122 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e7a8e12a-590b-4ed7-be24-06f5decc4723 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b" status: 200 len: 1319 microversion: 2.1 time: 0.158199 Sep 13 07:13:10.366950 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 567/1100] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:13:10 2022] GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:13:11.394063 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3c57b339-0b72-4c45-aa37-5f9f4a340098 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:13:11.395084 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3c57b339-0b72-4c45-aa37-5f9f4a340098 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 740fece7-c255-464c-9d25-88aa623b0e7b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:13:11.406351 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3c57b339-0b72-4c45-aa37-5f9f4a340098 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:11.407166 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3c57b339-0b72-4c45-aa37-5f9f4a340098 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:11.407892 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3c57b339-0b72-4c45-aa37-5f9f4a340098 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:11.409153 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3c57b339-0b72-4c45-aa37-5f9f4a340098 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:11.409905 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3c57b339-0b72-4c45-aa37-5f9f4a340098 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:11.410664 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3c57b339-0b72-4c45-aa37-5f9f4a340098 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:11.544873 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3c57b339-0b72-4c45-aa37-5f9f4a340098 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:13:11.553463 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3c57b339-0b72-4c45-aa37-5f9f4a340098 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b" status: 200 len: 1319 microversion: 2.1 time: 0.166268 Sep 13 07:13:11.554024 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 534/1101] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:13:11 2022] GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:13:11.902253 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-45a3545d-6274-4d09-91ca-19252e5bb49d req-cdbbb73b-13dd-4742-bd09-a880bb9e0105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "740fece7-c255-464c-9d25-88aa623b0e7b", "name": "network-vif-plugged", "status": "completed", "tag": "26183801-769d-4ac4-b83f-97bd657971c1"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:13:11.917478 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-45a3545d-6274-4d09-91ca-19252e5bb49d req-cdbbb73b-13dd-4742-bd09-a880bb9e0105 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:11.917848 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-45a3545d-6274-4d09-91ca-19252e5bb49d req-cdbbb73b-13dd-4742-bd09-a880bb9e0105 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:11.918584 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-45a3545d-6274-4d09-91ca-19252e5bb49d req-cdbbb73b-13dd-4742-bd09-a880bb9e0105 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:11.930195 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-45a3545d-6274-4d09-91ca-19252e5bb49d req-cdbbb73b-13dd-4742-bd09-a880bb9e0105 service nova] Creating event network-vif-plugged:26183801-769d-4ac4-b83f-97bd657971c1 for instance 740fece7-c255-464c-9d25-88aa623b0e7b on hv-cinder-85694 Sep 13 07:13:11.935623 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-45a3545d-6274-4d09-91ca-19252e5bb49d req-cdbbb73b-13dd-4742-bd09-a880bb9e0105 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037120 Sep 13 07:13:11.936425 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 568/1102] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:13:12.588580 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d25707ec-fe1f-4185-a413-90c980694b2e tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:13:12.589350 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d25707ec-fe1f-4185-a413-90c980694b2e tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 740fece7-c255-464c-9d25-88aa623b0e7b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:13:12.598289 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d25707ec-fe1f-4185-a413-90c980694b2e tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:12.598936 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d25707ec-fe1f-4185-a413-90c980694b2e tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:12.599423 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d25707ec-fe1f-4185-a413-90c980694b2e tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:12.600139 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d25707ec-fe1f-4185-a413-90c980694b2e tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:12.600583 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d25707ec-fe1f-4185-a413-90c980694b2e tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:12.601000 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d25707ec-fe1f-4185-a413-90c980694b2e tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:12.732865 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d25707ec-fe1f-4185-a413-90c980694b2e tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:13:12.741276 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d25707ec-fe1f-4185-a413-90c980694b2e tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b" status: 200 len: 1319 microversion: 2.1 time: 0.157827 Sep 13 07:13:12.741814 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 535/1103] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:13:12 2022] GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:13:13.764439 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:13:13.765689 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=6 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:13:13.772533 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8a9b6a48-bba3-4fc2-90d6-69393535affe tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:13:13.773236 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8a9b6a48-bba3-4fc2-90d6-69393535affe tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 740fece7-c255-464c-9d25-88aa623b0e7b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:13:13.780408 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8a9b6a48-bba3-4fc2-90d6-69393535affe tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:13.780887 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8a9b6a48-bba3-4fc2-90d6-69393535affe tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:13.781323 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8a9b6a48-bba3-4fc2-90d6-69393535affe tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:13.782010 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8a9b6a48-bba3-4fc2-90d6-69393535affe tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:13.782509 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8a9b6a48-bba3-4fc2-90d6-69393535affe tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:13.782933 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8a9b6a48-bba3-4fc2-90d6-69393535affe tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:13.919732 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8a9b6a48-bba3-4fc2-90d6-69393535affe tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:13:13.927683 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8a9b6a48-bba3-4fc2-90d6-69393535affe tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b" status: 200 len: 1507 microversion: 2.1 time: 0.165918 Sep 13 07:13:13.928250 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 569/1104] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:13:13 2022] GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:13:13.950519 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-319d13b0-1c47-4cbf-a31d-b54af786d55f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a55fe1b-691e-4b7c-b490-c634e4d0c7a5", "device": "/dev/sdb"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:13:13.953415 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-319d13b0-1c47-4cbf-a31d-b54af786d55f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 740fece7-c255-464c-9d25-88aa623b0e7b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:13:13.955401 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:13:13.961502 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-319d13b0-1c47-4cbf-a31d-b54af786d55f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:13.961982 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-319d13b0-1c47-4cbf-a31d-b54af786d55f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:13.962445 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-319d13b0-1c47-4cbf-a31d-b54af786d55f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:13.963139 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-319d13b0-1c47-4cbf-a31d-b54af786d55f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:13.963589 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-319d13b0-1c47-4cbf-a31d-b54af786d55f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:13.964012 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-319d13b0-1c47-4cbf-a31d-b54af786d55f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:14.242277 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-319d13b0-1c47-4cbf-a31d-b54af786d55f tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "POST /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295393 Sep 13 07:13:14.242921 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 536/1105] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Sep 13 07:13:13 2022] POST /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:13:30.664613 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-40d79d93-7f35-4d01-9c71-230fd57c4d8c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:13:30.665196 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-40d79d93-7f35-4d01-9c71-230fd57c4d8c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 740fece7-c255-464c-9d25-88aa623b0e7b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:13:30.667586 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:13:30.668349 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:13:30.675214 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-40d79d93-7f35-4d01-9c71-230fd57c4d8c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:30.675700 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-40d79d93-7f35-4d01-9c71-230fd57c4d8c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:30.676133 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-40d79d93-7f35-4d01-9c71-230fd57c4d8c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:30.676837 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-40d79d93-7f35-4d01-9c71-230fd57c4d8c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:30.677286 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-40d79d93-7f35-4d01-9c71-230fd57c4d8c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:30.677705 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-40d79d93-7f35-4d01-9c71-230fd57c4d8c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:30.771658 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-40d79d93-7f35-4d01-9c71-230fd57c4d8c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lazy-loading 'services' on Instance uuid 740fece7-c255-464c-9d25-88aa623b0e7b {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:13:30.862565 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-40d79d93-7f35-4d01-9c71-230fd57c4d8c tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "DELETE /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b/os-volume_attachments/4a55fe1b-691e-4b7c-b490-c634e4d0c7a5" status: 202 len: 0 microversion: 2.1 time: 0.202124 Sep 13 07:13:30.863149 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 570/1106] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Sep 13 07:13:30 2022] DELETE /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b/os-volume_attachments/4a55fe1b-691e-4b7c-b490-c634e4d0c7a5 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:13:31.994311 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-db486214-7c09-4807-be20-c8d1b76ce54b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:13:31.994864 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-db486214-7c09-4807-be20-c8d1b76ce54b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 740fece7-c255-464c-9d25-88aa623b0e7b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:13:31.998484 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=24 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:13:31.999211 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:13:32.005882 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-db486214-7c09-4807-be20-c8d1b76ce54b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:32.006390 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-db486214-7c09-4807-be20-c8d1b76ce54b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:32.006815 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-db486214-7c09-4807-be20-c8d1b76ce54b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:32.007515 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-db486214-7c09-4807-be20-c8d1b76ce54b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:32.007965 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-db486214-7c09-4807-be20-c8d1b76ce54b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:32.008387 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-db486214-7c09-4807-be20-c8d1b76ce54b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:32.038532 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-db486214-7c09-4807-be20-c8d1b76ce54b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 740fece7-c255-464c-9d25-88aa623b0e7b] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:13:32.123522 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-db486214-7c09-4807-be20-c8d1b76ce54b tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "DELETE /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b" status: 204 len: 0 microversion: 2.1 time: 0.132920 Sep 13 07:13:32.124118 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 537/1107] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Sep 13 07:13:31 2022] DELETE /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 07:13:32.133940 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1e96d1e9-3ec3-40b7-86f9-42b3fb0729f0 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:13:32.134699 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1e96d1e9-3ec3-40b7-86f9-42b3fb0729f0 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 740fece7-c255-464c-9d25-88aa623b0e7b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:13:32.142002 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1e96d1e9-3ec3-40b7-86f9-42b3fb0729f0 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:32.142528 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1e96d1e9-3ec3-40b7-86f9-42b3fb0729f0 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:32.142960 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1e96d1e9-3ec3-40b7-86f9-42b3fb0729f0 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:32.143654 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1e96d1e9-3ec3-40b7-86f9-42b3fb0729f0 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:32.144107 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1e96d1e9-3ec3-40b7-86f9-42b3fb0729f0 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:32.144528 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1e96d1e9-3ec3-40b7-86f9-42b3fb0729f0 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:32.287269 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1e96d1e9-3ec3-40b7-86f9-42b3fb0729f0 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:13:32.296160 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1e96d1e9-3ec3-40b7-86f9-42b3fb0729f0 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b" status: 200 len: 1513 microversion: 2.1 time: 0.167184 Sep 13 07:13:32.296795 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 571/1108] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:13:32 2022] GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:13:33.325777 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ed7fdc02-dfc6-42f1-a64d-d30ff99c5bd0 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:13:33.326552 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ed7fdc02-dfc6-42f1-a64d-d30ff99c5bd0 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 740fece7-c255-464c-9d25-88aa623b0e7b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:13:33.334356 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed7fdc02-dfc6-42f1-a64d-d30ff99c5bd0 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:33.336237 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed7fdc02-dfc6-42f1-a64d-d30ff99c5bd0 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:33.336728 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed7fdc02-dfc6-42f1-a64d-d30ff99c5bd0 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:33.337510 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed7fdc02-dfc6-42f1-a64d-d30ff99c5bd0 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:33.338016 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed7fdc02-dfc6-42f1-a64d-d30ff99c5bd0 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:33.338501 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed7fdc02-dfc6-42f1-a64d-d30ff99c5bd0 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:33.479140 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ed7fdc02-dfc6-42f1-a64d-d30ff99c5bd0 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:13:33.491036 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ed7fdc02-dfc6-42f1-a64d-d30ff99c5bd0 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b" status: 200 len: 1513 microversion: 2.1 time: 0.171894 Sep 13 07:13:33.491814 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 538/1109] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:13:33 2022] GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:13:34.483567 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-23730de1-696e-4751-adfa-abc14528afd5 req-85b3d2e7-f550-4dae-b368-3587d7d9c3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "740fece7-c255-464c-9d25-88aa623b0e7b", "name": "network-vif-deleted", "tag": "26183801-769d-4ac4-b83f-97bd657971c1"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:13:34.496946 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-23730de1-696e-4751-adfa-abc14528afd5 req-85b3d2e7-f550-4dae-b368-3587d7d9c3a5 service nova] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:34.497420 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-23730de1-696e-4751-adfa-abc14528afd5 req-85b3d2e7-f550-4dae-b368-3587d7d9c3a5 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:34.497846 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-23730de1-696e-4751-adfa-abc14528afd5 req-85b3d2e7-f550-4dae-b368-3587d7d9c3a5 service nova] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:34.509093 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-23730de1-696e-4751-adfa-abc14528afd5 req-85b3d2e7-f550-4dae-b368-3587d7d9c3a5 service nova] Creating event network-vif-deleted:26183801-769d-4ac4-b83f-97bd657971c1 for instance 740fece7-c255-464c-9d25-88aa623b0e7b on hv-cinder-85694 Sep 13 07:13:34.514974 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-23730de1-696e-4751-adfa-abc14528afd5 req-85b3d2e7-f550-4dae-b368-3587d7d9c3a5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035294 Sep 13 07:13:34.515845 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 572/1110] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Sep 13 07:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:13:34.516354 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b71836f1-5881-408b-aa8c-aba5e957a0f2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:13:34.516935 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b71836f1-5881-408b-aa8c-aba5e957a0f2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 740fece7-c255-464c-9d25-88aa623b0e7b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:13:34.524620 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b71836f1-5881-408b-aa8c-aba5e957a0f2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:34.525100 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b71836f1-5881-408b-aa8c-aba5e957a0f2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:34.525563 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b71836f1-5881-408b-aa8c-aba5e957a0f2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:34.526269 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b71836f1-5881-408b-aa8c-aba5e957a0f2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:34.526719 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b71836f1-5881-408b-aa8c-aba5e957a0f2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:34.527138 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b71836f1-5881-408b-aa8c-aba5e957a0f2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:34.593505 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b71836f1-5881-408b-aa8c-aba5e957a0f2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97914dfbd4994558a3df3c3d6fb645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6c0d2b084418483a72536fbb6716a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:13:34.602565 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b71836f1-5881-408b-aa8c-aba5e957a0f2 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b" status: 200 len: 1304 microversion: 2.1 time: 0.090492 Sep 13 07:13:34.603173 dv-cinder-856941-4-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 539/1111] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:13:34 2022] GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:13:35.626118 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8880c6ee-7def-4325-9fb8-1c6b4ce70ea8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:13:35.626847 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8880c6ee-7def-4325-9fb8-1c6b4ce70ea8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] [instance: 740fece7-c255-464c-9d25-88aa623b0e7b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:13:35.633777 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8880c6ee-7def-4325-9fb8-1c6b4ce70ea8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:35.634314 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8880c6ee-7def-4325-9fb8-1c6b4ce70ea8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:35.634749 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8880c6ee-7def-4325-9fb8-1c6b4ce70ea8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:35.635461 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8880c6ee-7def-4325-9fb8-1c6b4ce70ea8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Acquiring lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:13:35.635917 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8880c6ee-7def-4325-9fb8-1c6b4ce70ea8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:13:35.636343 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8880c6ee-7def-4325-9fb8-1c6b4ce70ea8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Lock "bb5fd9cb-18fe-4379-ac3d-53b158992ccd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:13:35.651255 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-8880c6ee-7def-4325-9fb8-1c6b4ce70ea8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] HTTP exception thrown: Instance 740fece7-c255-464c-9d25-88aa623b0e7b could not be found. Sep 13 07:13:35.652964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8880c6ee-7def-4325-9fb8-1c6b4ce70ea8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Request method failure captured: Sep 13 07:13:35.652964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b HTTP/1.1 Sep 13 07:13:35.652964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept: application/json Sep 13 07:13:35.652964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Sep 13 07:13:35.652964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Connection: close Sep 13 07:13:35.652964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Length: 0 Sep 13 07:13:35.652964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Content-Type: application/json Sep 13 07:13:35.652964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Host: 10.222.0.25 Sep 13 07:13:35.652964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Sep 13 07:13:35.652964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Sep 13 07:13:35.652964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjIC09Pbc4CyDfaZr3-MGTI7Dqqu1u5Xa8AdOOy1avRfGi4LmaFz76ehe4rbilrNV_eJfP6aMGErLho4Tmy00FxVYc0Ql5kcd7EW_oqx5UGrNNwpXIy6fXhKUtTr-dWYSO_YPpknBbIQR23iC-rl3uDeVYcla9rvEcNoKibu5WwkKPqtc Sep 13 07:13:35.652964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Sep 13 07:13:35.652964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Sep 13 07:13:35.652964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Sep 13 07:13:35.652964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Sep 13 07:13:35.652964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Sep 13 07:13:35.652964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Sep 13 07:13:35.652964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Id: bfd6c0d2b084418483a72536fbb6716a Sep 13 07:13:35.652964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1055383426 Sep 13 07:13:35.652964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Role: reader,member Sep 13 07:13:35.652964 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Sep 13 07:13:35.654771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bfd6c0d2b084418483a72536fbb6716a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bfd6c0d2b084418483a72536fbb6716a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bfd6c0d2b084418483a72536fbb6716a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bfd6c0d2b084418483a72536fbb6716a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Sep 13 07:13:35.654771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-VolumesSnapshotTestJSON-1055383426 Sep 13 07:13:35.654771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Id: bfd6c0d2b084418483a72536fbb6716a Sep 13 07:13:35.654771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1055383426 Sep 13 07:13:35.654771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User: tempest-VolumesSnapshotTestJSON-1055383426-project Sep 13 07:13:35.654771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Sep 13 07:13:35.654771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Sep 13 07:13:35.654771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Id: 97914dfbd4994558a3df3c3d6fb645f5 Sep 13 07:13:35.654771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-VolumesSnapshotTestJSON-1055383426-project Sep 13 07:13:35.654771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: method: > Sep 13 07:13:35.654771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: exception: Instance 740fece7-c255-464c-9d25-88aa623b0e7b could not be found. Sep 13 07:13:35.654771 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: action_args: {'id': '740fece7-c255-464c-9d25-88aa623b0e7b'} Sep 13 07:13:35.655724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:13:35.655724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:13:35.655724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:13:35.655724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:13:35.655724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:13:35.655724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:13:35.655724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:13:35.655724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:13:35.655724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:13:35.655724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:13:35.655724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 740fece7-c255-464c-9d25-88aa623b0e7b could not be found. Sep 13 07:13:35.655724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:13:35.655724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:13:35.655724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:13:35.655724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:13:35.655724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:13:35.655724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:13:35.655724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:13:35.655724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:13:35.655724 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:13:35.657170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:13:35.657170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:13:35.657170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:13:35.657170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:13:35.657170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:13:35.657170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:13:35.657170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:13:35.657170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 740fece7-c255-464c-9d25-88aa623b0e7b could not be found. Sep 13 07:13:35.657170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:13:35.657170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:13:35.657170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:13:35.657170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:13:35.657170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:13:35.657170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:13:35.657170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:13:35.657170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:13:35.657170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 740fece7-c255-464c-9d25-88aa623b0e7b could not be found. Sep 13 07:13:35.657170 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Sep 13 07:13:35.658583 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8880c6ee-7def-4325-9fb8-1c6b4ce70ea8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] Returning 404 to user: Instance 740fece7-c255-464c-9d25-88aa623b0e7b could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:13:35.658583 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8880c6ee-7def-4325-9fb8-1c6b4ce70ea8 tempest-VolumesSnapshotTestJSON-1055383426 tempest-VolumesSnapshotTestJSON-1055383426-project] 10.222.0.25 "GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b" status: 404 len: 111 microversion: 2.1 time: 0.033078 Sep 13 07:13:35.658583 dv-cinder-856941-4-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 573/1112] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Sep 13 07:13:35 2022] GET /compute/v2.1/servers/740fece7-c255-464c-9d25-88aa623b0e7b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)